Python Playground

I was able to modify the cache settings of an HDF5 file by combining both the high and low level Py… Read more How To Close An Hdf5 Using Low Level Python Api?

I am trying to store about 3000 numpy arrays using HDF5 data format. Arrays vary in length from 530… Read more Saving With H5py Arrays Of Different Sizes

I have several big HDF5 file stored on an SSD (lzf compressed file size is 10–15 GB, uncompressed s… Read more How To Speed Up Reading From Compressed Hdf5 Files

I have a DataFrame in Pandas: In [7]: my_df Out[7]: Int64Index: 34 entries, 0 to 0 Columns: 2661 … Read more Unable To Save Dataframe To Hdf5 ("object Header Message Is Too Large")

Using Numpy and h5py, it is possible to create ‘compound datatype’ datasets to be stored in an hdf5… Read more H5py: Compound Datatypes And Scale-offset In The Compression Pipeline

Is it clear what I am doing wrong? I'm experimenting with pandas HDFStore.select start and stop… Read more Hdfstore Start Stop Not Working

I have a huge list of numpy arrays, specifically 113287, where each array is of shape 36 x 2048. In… Read more Fast And Efficient Way Of Serializing And Retrieving A Large Number Of Numpy Arrays From Hdf5 File

Problem I have a large (> 500e6 rows) dataset that I've put into a pytables database. Lets … Read more Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows