Sparse matrices / arrays in Java

Posted by DanM on Stack Overflow See other posts from Stack Overflow or by DanM
Published on 2008-12-23T21:55:14Z Indexed on 2010/03/22 21:41 UTC
Read the original article Hit count: 532

Filed under:

sparse-array

|

sparse-matrix

|

java

|

algorithm

|

library

I'm working on a project, written in Java, which requires that I build a very large 2-D sparse array. Very sparse, if that makes a difference. Anyway: the most crucial aspect for this application is efficency in terms of time (assume loads of memory, though not nearly so unlimited as to allow me to use a standard 2-D array -- the key range is in the billions in both dimensions).

Out of the kajillion cells in the array, there will be several hundred thousand cells which contain an object. I need to be able to modify cell contents VERY quickly.

Anyway: Does anyone know a particularly good library for this purpose? It would have to be Berkeley, LGPL or similar license (no GPL, as the product can't be entirely open-sourced). Or if there's just a very simple way to make a homebrew sparse array object, that'd be fine too.

I'm considering MTJ, but haven't heard any opinions on its quality.

Thanks!! -Dan

© Stack Overflow or respective owner

Related posts about sparse-array

Sparse matrices / arrays in Java

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm working on a project, written in Java, which requires that I build a very large 2-D sparse array. Very sparse, if that makes a difference. Anyway: the most crucial aspect for this application is efficency in terms of time (assume loads of memory, though not nearly so unlimited as to allow me… >>> More
Decode sparse json array to php array

as seen on Stack Overflow - Search for 'Stack Overflow'
I can create a sparse php array (or map) using the command: $myarray = array(10=>'hi','test20'=>'howdy'); I want to serialize/deserialize this as JSON. I can serialize it using the command: $json = json_encode($myarray); which results in the string {"10":"hi","test20":"howdy"}. However… >>> More
Sparse O(1) array with indices being consecutive products

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, I'd like to pre-calculate an array of values of some unary function f. I know that I'll only need the values for f(x) where x is of the form of a*b, where both a and b are integers in range 0..N. The obvious time-optimized choice is just to make an array of size N*N and just pre-calculate… >>> More
java: sparse bit vector

as seen on Stack Overflow - Search for 'Stack Overflow'
Are there any well-known libraries in Java for sparse bit sets? (And are there guidelines for how sparse is useful to use them vs. java.util.BitSet?) >>> More
how to implement a sparse_vector class

as seen on Stack Overflow - Search for 'Stack Overflow'
I am implementing a templated sparse_vector class. It's like a vector, but it only stores elements that are different from their default constructed value. So, sparse_vector would store the index-value pairs for all indices whose value is not T(). I am basing my implementation on existing sparse… >>> More

Related posts about sparse-matrix

In R, when using named rows, can a sparse matrix column be added to another sparse matrix?

as seen on Stack Overflow - Search for 'Stack Overflow'
I have two sparse matrices, m1 and m2: > m1 <- Matrix(data=0,nrow=2, ncol=1, sparse=TRUE, dimnames=list(c("b","d"),NULL)) > m2 <- Matrix(data=0,nrow=2, ncol=1, sparse=TRUE, dimnames=list(c("a","b"),NULL)) > m1["b",1]<- 4 > m2["a",1]<- 5 > m1 2 x 1 sparse Matrix of class… >>> More
Find the "largest" dense sub matrix in a large sparse matrix

as seen on Stack Overflow - Search for 'Stack Overflow'
Given a large sparse matrix (say 10k+ by 1M+) I need to find a subset, not necessarily continuous, of the rows and columns that form a dense matrix (all non-zero elements). I want this sub matrix to be as large as possible (not the largest sum, but the largest number of elements) within some aspect… >>> More
MATLAB: Convert two array to a sparse matrix

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm looking for an a command or trick to convert two arrays to a sparse matrix. The two arrays contain x-values and y-values, which gives a coordinate in the cartesian coordinate system. I want to group the coordinates, which if the value is between some value on the x-axes and the y-axes. % MATLAB x_i… >>> More
best way to get a vector from sparse matrix

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I have a m x n matrix where each row consists of zeros and same values for each row. an example would be: M = -0.6 1.8 -2.3 0 0 0; 0 0 0 3.4 -3.8 -4.3; -0.6 0 0 3.4 0 0 In this example the first column consists of 0s and -0.6, second 0 and 1.8, third -2.3 and so on. In such case I would like… >>> More
Vectorizatoin of index operation for a scipy.sparse matrix

as seen on Stack Overflow - Search for 'Stack Overflow'
The following code runs too slowly even though everything seems to be vectorized. from numpy import * from scipy.sparse import * n = 100000; i = xrange(n); j = xrange(n); data = ones(n); A=csr_matrix((data,(i,j))); x = A[i,j] The problem seems to be that the indexing operation is implemented… >>> More