-
block-buffer
Buffer type for block processing of data
-
aws-sdk-emr
AWS SDK for Amazon EMR
-
frd_pu
A high-performance, zero-dependency library for creating efficient and fast applications
-
yamlscript
Program in YAML — Code is Data
-
subtr-actor
Rocket League replay transformer
-
data-url
Processing of data: URL according to WHATWG’s Fetch Standard
-
cano
& Fast Async Workflows in Rust - Build data processing pipelines with Tasks and Nodes
-
trustfall
query engine, empowering you to query everything
-
fluvio-stream-dispatcher
Fluvio Event Stream access
-
new_york_calculate_core
calculation some things
-
grib-cli
CLI application for processing GRIB format data, built on the top of the library
grib -
neuromorphic-types
Shared Neuromorphic data types for drivers and processing frameworks
-
razel
a command executor with caching for data processing pipelines
-
enc
aids in processing encoded data
-
csv_log_cleaner
Clean CSV files to conform to a type schema by streaming them through small memory buffers using multiple threads and logging data loss
-
veloxx
High-performance, lightweight Rust library for in-memory data processing and analytics. Features DataFrames, Series, advanced I/O (CSV, JSON, Parquet), machine learning (linear regression…
-
astrors
Astronomical package to deal with FITS files (tables and images). An effort to develop a common core package for Astronomy in Rust.
-
dyer-cli
great tool created to guide you use dyer fast and at ease, helps you build a robust crawler, data processor, netwrok program fast and correctly
-
jsonschema-transpiler
transpile JSON Schema into schemas for data processing
-
gt7_server
A server for GT7 telemetry data processing
-
e9571_json_lib
JSON serialization, deserialization, and non-standard JSON parsing
-
yngvi
Read, calculate and write weather data
-
feagi_core_data_structures_and_processing
FEAGI libraries to use to handle data processing
-
feagi_core_data_structures_and_processing_nightly
FEAGI libraries to use to handle data processing
-
ppl
A structured parallel programming library for Rust
-
fluvio-spu-schema
Fluvio API for SPU
-
batch-processing
A batch library for processing a list of items in parallel
-
e9571_config-reader
read config.json from executable directory
-
decode
A High-Performance Query Tool for JSON, YAML and TOML
-
ibuf
A memory buffer pool implementation
-
tremor-script
Tremor Script Interpreter
-
ecad-processor
High-performance multi-metric weather data processor for European Climate Assessment & Dataset (ECA&D) archives with Parquet output
-
flowgger
fast, simple and lightweight data collector
-
scbl-utils
A command-line utility for data processing and delivery at the Single Cell Biology Lab at the Jackson Laboratory
-
epiq
Laboratory for pipeline construction with feedback
-
deltoid
calculate and apply deltas to structs and enums
-
tea-dyn
that primarily defines traits for dynamic vector operations, enabling flexible data processing across various types and backends
-
traqq
High-performance event processing system for Redis data indexing
-
round_pipers
A way to pipe ndarrays using circular buffers
-
fluxus
lightweight stream processing engine written in Rust, designed for efficient real-time data processing and analysis
-
egml
processing GML data
-
par-stream
Asynchronous parallel streams analogous to rayon
-
e9571_file_lib
file and directory operations, including MD5 hashing and recursive copying
-
ecitygml
processing CityGML data
-
ecitygml-cli
CLI tool for processing CityGML data
-
byte-tools
Bytes related utility functions
-
mongo-collector
CLI tool for extracting values of a specific field from a MongoDB collection and saving them into a target collection
-
rsflow
High-performance Rust flow processing engine
-
cortex-ai
An asynchronous flow-based processing framework for building flexible data pipelines with conditional branching and error handling
-
dyer
designed for reliable, flexible and fast Request-Response based service, including data processing, web-crawling and so on, providing some friendly, flexible, comprehensive features without compromising speed
-
egml-cli
CLI tool for processing GML data
-
pipeline_derive
A procedural macro crate to simplify building monadic-like data pipelines in Rust
-
resol-vbus
processing RESOL VBus data
-
wikidump
parsing Mediawiki XML dumps
-
e9571_base64_pro_lib
base64 encoding/decoding with special character handling and file conversion support
-
ngs
Command line tool for processing next-generation sequencing data
-
fluvio-system-util
Fluvio System components
-
shepherd-rs
Shepherd is a resilient, non-blocking orchestrator that persistently transforms and delivers data—built for remote, compute-heavy workloads
-
streaming_serde_json
streaming alternative to serde_json for processing JSON data sources that are too large to fit in memory
-
ecitygml-io
IO operations for processing CityGML data
-
fluxus-utils
components for Fluxus stream processing engine
-
egml-io
IO operations for processing GML data
-
noir-compute
Network of Operators In Rust
-
ecitygml-transform
Supplementary operations for CityGML data
-
fluxus-transformers
Transformer components for Fluxus stream processing engine
-
agnes
A data wrangling library for Rust
-
pflw
Python Dataflow Framework in Rust
-
black-jack
DataFrame / Series / general data processing in Rust
-
rusty-talib
using pure rust code for technical analysis
-
async-pipes
building concurrent data processing pipelines
-
j9
Rust interface for jq-based JSON processing
-
ts-merger
A multi-threaded tool for processing and aggregating time series data files
-
fluxus-sinks
Sink components for Fluxus stream processing engine
-
archiv
Read and write compressed, length-prefixed streams or file(s)
-
rs-zips2meta2parquet
Converts the metadata values of the zip files to a parquet
-
fluxus-sources
Source components for Fluxus stream processing engine
-
fluvio-controlplane
Fluvio control plane API
-
strm-privacy-driver
Rust API driver for STRMPrivacy
-
dr
Command-line data file processing in Rust
-
std-dev
Your Swiss Army knife for swiftly processing any amount of data. Implemented for industrial and educational purposes alike.
-
sanitise
Headache-free data clean-up
-
mako
main Sidekick AI data processing library
-
fluxus-sink-telegram
A Telegram sink component for the Fluxus stream processing framework, enabling real-time message delivery to Telegram channels and chats
-
meteomatics
Query weather and climate data from the Meteomatics API (https://www.meteomatics.com/en/)
-
gex_sys_build_parse_mak
Parse mak file to build gex-sys
-
dukascopy_rust
Rust wrapper for Dukascopy’s free charting API
-
wd2sql
Transform a Wikidata JSON dump into an SQLite database
-
vehicle_parser
Parse data about vehicles to json
-
rusted_pipe
Real time processing library for developing multithreaded ML pipelines, written in Rust
-
take_put_back
A common abstraction of the process of taking some piece out, processing it and then putting it back
-
flowing
flow graph processing library
-
einfach-xml-builder
A lightweight and intuitive library for generating XML documents in Rust
-
codebake
data processing framework and lisp
-
punch_api
Punch WebAssembly public API
-
openai-api-stream-rs
that provides a simple function for interacting with the OpenAI API and performing language-based tasks. This crate focuses on streaming responses from the API, enabling real-time processing of large amounts of data.
-
querent-rs
bridge capable of handling and executing querent workflows and be able to respond to incoming events via callbacks
-
shr_parser_py
Python bindings for the shr_parser Rust crate
-
tavlars
Tabular data processing for humans
-
aoc_data
parsing and processing data from the AoC API
-
cortex-sources
Ready-made source implementations for various data inputs in the Cortex ecosystem
-
dataflow_nlp
Dataflow is a data processing library, primarily for machine learning
-
maelstrom-core
Tools for processing of NGS data
-
postquet
Stream PostgreSQL tables/queries to Parquet files seamlessly with this high-performance, Rust-based command-line tool
-
nitric
A general-purpose data-processing library
-
shutter
Image processing data structures and algorithms
Try searching with DuckDuckGo.