[P] Repository of efficient scripts for automatic conversion to TFRecords
Hello everyone, I recently noticed that the use of TFRecords isn't as popular as it should be. The efficiency and advantages that it provides, including but not limited to easy integration into TPU pipelines for Tensorflow, led me to creating a repository full of command line scripts to convert data from all popular domains like Audio, Text and Images (with video support coming soon) to TFRecord formats. The scripts also contain support for automatic SQLite and CSV datatype parsing and buffering. Along with this, they support an option for multiprocessing and are made with minimization of memory footprint in mind. If you are interested then please check out the repository here, give it a star if it is helpful and let me know if you have any feedback or suggestion.
Mar-6-2021, 17:01:35 GMT
- Technology: