Questions Tagged [Lmdb]

It is the mmap’d database for OpenLDAP aka Lightning MDB (LMDB).

241 questions
-1 votes
0 answers
11 views

caffe2 - create own MNIST lmdb dataset from numpy array

I am currently trying to create a MNIST lmdb dataset from my own data saved as numpy arrays data (shape (50000,1,28,28)) and label (shape (50000,)). Does someone know how to convert numpy arrays to a ...
0 votes
1 answer
25 views

Building LMDB master branch on Windows

I'm trying to build LMDB from master branch, because Windows incremental file growth patch is not merged into release branch. I'm using CMake and MSVC compiler. And I'm trying to build lmdb as a ...
  • 480
0 votes
2 answers
74 views

Are the contents in a LMDB always stored BOTH in disk AND memory?

I'm wanting to use the rust implementation of LMDB but I can't seem to find whether it would always maintain a copy of whats in memory also in the disk and viceversa. My reasoning would be that the DB ...
2 votes
1 answer
96 views

How to convert lmdb file to PySpark Image DataFrame?

I have a lmdb file whose value contains jpeg image data in binary string format. I want to save all the images to a folder and create a PySpark DataFrame to do my analysis. I am doing this because I ...
-3 votes
2 answers
229 views

retrieving data from lmdb in python is throwing error

This is how the dataset was created def createDataset1( outputPath, imagePathList, labelList, lexiconList=None, validset_percent=10, testset_percent=0, random_seed=1111, ...
  • 1,137
0 votes
0 answers
50 views

python tensorpack dataflow - how to generate lmdb file? LMDBSerializer.save never ends

I am using edited code from as I do not want to use it for Conceptual Captions dataset (because it is huge) but ...
  • 1
1 vote
0 answers
60 views

Best data structure for random (indexed) access/removal of pre-sorted data

The data set consists of increasing values. Data is always appended, and thus is inherently sorted. There is no need for random insertions in the middle or beginning of the set, however, random ...
0 votes
0 answers
57 views

Drop in disk read speed during loading lmdb files on Ubuntu

I have lmdb files stored on a nvme ssd to be loaded to memory using the following python code. The server is running ubuntu 18.04. The read speed of the drive (as tested using hdparm) is >17.5G/s (...
0 votes
0 answers
12 views

how to access the key value pair of the values of a lmdb database?

I was searching for answers for hours and still did not get anything useful, except a couple of links mentioning to use the caffe module, which looks ...
4 votes
1 answer
933 views

Unable to make field long java.nio.Buffer.address accessible: module java.base does not "opens java.nio" - LMDB using Java API

I'm trying to create DB and env using LMDB. I'm facing an issue on Env. create(). I have used LMDB documentation for this. Exception in thread "main" java.lang.ExceptionInInitializerError ...
0 votes
0 answers
97 views

LMDB delete multiple keys

Does LMDB support notion of deleting a sub-tree with partial key specified like you would do in a tree? For illustration consider the following keys. 6.1.1.0 6.1.2.0 6.2.1.0 6.2.2.0 6.3.1.0 6.3.2.0 Is ...
0 votes
0 answers
68 views

lmdb with Virtual File System

i want to use lmdb on a stm32 microcontroller (ARM Cortex M4). I have no Operational-System but i have littlefs as a filesystem installed. For sqlite there exists a mechanism that is called "VFS&...
  • 13
0 votes
0 answers
83 views

AttributeError: Cannot import 'lmdb', therefore 'LMDBSerializer' is not available

i'm using tensorpack and lmdb the first time and getting this error: AttributeError: Cannot import 'lmdb', therefore 'LMDBSerializer' is not available Unfortunately, I can't find much about it ...
0 votes
1 answer
95 views

Form B-Tree back from lmdb database

I'm traversing a tree and forming a (key:value) lmdb database. I'm struggling to form the tree back iterating lmdb. Can one suggest how to form the tree back by iterating over the Databases which is (...
1 vote
1 answer
88 views

how to form tree database structure using lmdb

Here I'm trying to create graph database whose structure will look following. As I keep adding more nodes, I don't see the depth of the tree increasing. Can one suggest what I might be doing wrong ...

15 30 50 per page
1
2 3 4 5
…
17
James H. Sterling

James H. Sterling

Environmental Science & Climate Journalist

James Sterling reports on renewable energy developments, climate policy, ecological conservation, and green tech innovations around the globe.

Share this article
Twitter Facebook Pinterest