Questions Tagged [Lmdb]
Ask Question It Is the Mmap’d Database for Openldap Aka Lightning Mdb (Lmdb). 241 Questions More Bountied 0 Unanswered Frequent Score Unanswered (My Tags)...
It is the mmap’d database for OpenLDAP aka Lightning MDB (LMDB).
241
questions
-1
votes
0
answers
11
views
caffe2 - create own MNIST lmdb dataset from numpy array
I am currently trying to create a MNIST lmdb dataset from my own data saved as numpy arrays data (shape (50000,1,28,28)) and label (shape (50000,)).
Does someone know how to convert numpy arrays to a ...
0
votes
1
answer
25
views
Building LMDB master branch on Windows
I'm trying to build LMDB from master branch, because Windows incremental file growth patch is not merged into release branch.
I'm using CMake and MSVC compiler. And I'm trying to build lmdb as a ...
0
votes
2
answers
74
views
Are the contents in a LMDB always stored BOTH in disk AND memory?
I'm wanting to use the rust implementation of LMDB but I can't seem to find whether it would always maintain a copy of whats in memory also in the disk and viceversa.
My reasoning would be that the DB ...
2
votes
1
answer
96
views
How to convert lmdb file to PySpark Image DataFrame?
I have a lmdb file whose value contains jpeg image data in binary string format. I want to save all the images to a folder and create a PySpark DataFrame to do my analysis. I am doing this because I ...
-3
votes
2
answers
229
views
retrieving data from lmdb in python is throwing error
This is how the dataset was created
def createDataset1(
outputPath,
imagePathList,
labelList,
lexiconList=None,
validset_percent=10,
testset_percent=0,
random_seed=1111,
...
0
votes
0
answers
50
views
python tensorpack dataflow - how to generate lmdb file? LMDBSerializer.save never ends
I am using edited code from as I do not want to use it for Conceptual Captions dataset (because it is huge) but ...
1
vote
0
answers
60
views
Best data structure for random (indexed) access/removal of pre-sorted data
The data set consists of increasing values. Data is always appended, and thus is inherently sorted. There is no need for random insertions in the middle or beginning of the set, however, random ...
0
votes
0
answers
57
views
Drop in disk read speed during loading lmdb files on Ubuntu
I have lmdb files stored on a nvme ssd to be loaded to memory using the following python code. The server is running ubuntu 18.04. The read speed of the drive (as tested using hdparm) is >17.5G/s (...
0
votes
0
answers
12
views
how to access the key value pair of the values of a lmdb database?
I was searching for answers for hours and still did not get anything useful, except a couple of links mentioning to use the caffe module, which looks ...
4
votes
1
answer
933
views
Unable to make field long java.nio.Buffer.address accessible: module java.base does not "opens java.nio" - LMDB using Java API
I'm trying to create DB and env using LMDB. I'm facing an issue on Env. create().
I have used LMDB documentation for this.
Exception in thread "main" java.lang.ExceptionInInitializerError
...
0
votes
0
answers
97
views
LMDB delete multiple keys
Does LMDB support notion of deleting a sub-tree with partial key specified like you would do in a tree?
For illustration consider the following keys.
6.1.1.0
6.1.2.0
6.2.1.0
6.2.2.0
6.3.1.0
6.3.2.0
Is ...
0
votes
0
answers
68
views
lmdb with Virtual File System
i want to use lmdb on a stm32 microcontroller (ARM Cortex M4).
I have no Operational-System but i have littlefs as a filesystem installed.
For sqlite there exists a mechanism that is called "VFS&...
0
votes
0
answers
83
views
AttributeError: Cannot import 'lmdb', therefore 'LMDBSerializer' is not available
i'm using tensorpack and lmdb the first time and getting this error:
AttributeError: Cannot import 'lmdb', therefore 'LMDBSerializer' is not available
Unfortunately, I can't find much about it ...
0
votes
1
answer
95
views
Form B-Tree back from lmdb database
I'm traversing a tree and forming a (key:value) lmdb database. I'm struggling to form the tree back iterating lmdb.
Can one suggest how to form the tree back by iterating over the Databases which is (...
1
vote
1
answer
88
views
how to form tree database structure using lmdb
Here I'm trying to create graph database whose structure will look following. As I keep adding more nodes, I don't see the depth of the tree increasing. Can one suggest what I might be doing wrong ...