Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Massive RAM in moderate problem #171

Open
cossio opened this issue Dec 14, 2018 · 0 comments
Open

Massive RAM in moderate problem #171

cossio opened this issue Dec 14, 2018 · 0 comments

Comments

@cossio
Copy link

cossio commented Dec 14, 2018

I have an example of a moderately sized problem which consumes massive RAM memory. I have no idea why this happens. Is there something inherently difficult to this kind of problem? Or is this a bug in ECOS?

I am using ECOS through Convex.jl, ECOS.jl, in Julia. I'm sorry if some people here aren't familiar with Julia. Hopefully someone else can translate this to other language if needed.

To run this code, you need to load the variables N, Adj from the .jld2 file (using JLD2.jl) here:

https://github.com/cossio/cvx_example_data

N is an float 3-dimensional Array, and Adj a sparse matrix.

WARNING: The following code took so much memory that I had to reboot my laptop. Run this in a contained environment where you can constrain memory consumption.

x = Variable(2730)
S, V, T = size(N)
lN = log.(N)
M = vec(sum(N[:,:,2:T]; dims=(2,3)))
H = Adj * x
problem = maximize(-sum(logsumexp(lN[:,v,t] - H) for t = 1:T-1, v = 1:V) - dot(M, H), [x  -1e2, x  1e2])  
solve!(problem, ECOSSolver())  # huge RAM consumption here

I originally reported this here: jump-dev/Convex.jl#254.
But now I realize it's an issue with the solver.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant