FireDucks
Compiler Accelerated DataFrame Library for Python with fully-compatible pandas API
Get Startedimport fireducks.pandas as pd
Talk: Best practices to improve computational time and memory when writing pandas application at Tokyo Python September Meetup (Sep 11, 2024)
Updated TPC-H Benchmark: 50x average speedup over pandas, 1.3x average speedup over polars (Sep 10, 2024)
Article: Analyzing Amazon Reviews using FireDucks at lightning speed just like Amazon delivery (Sep 06, 2024)
Talk: August Meetup Events: MumPy, PyData OMR (Aug 31, 2024)
Talk: Accelerate Your Pandas Scripts with 1 Line of Code (FireDucks) at TDE Workshop (Aug 27, 2024)
Do you have a pandas-based program that is slow? FireDucks can speed-up your programs without any manual code changes. You can accelerate your data analysis without worrying about slow performance due to single-threaded execution in pandas.
Concerned about the cost and environmental impact of cloud computing? Our acceleration technology reduces cloud usage fees, while minimizing the CO2 emissions at the same time, making FireDucks an environment-friendly and wallet-friendly choice.
FireDucks is developed by infusing the essence of supercomputers that NEC has refined over the years. Made in Japan, high-quality FireDucks promises reliability and high performance.
Features
FireDucks is multi-threaded, enabling higher speeds on multi-core CPUs. More
A runtime compiler embedded in the library optimizes your code. More
FireDucks is fully compatible with pandas API. The only difference is the import statement. No additional learning is required to start with FireDucks.Get started
You can run your pandas program directly with FireDucks. Its import-hook functionality will automatically replace the import statement for pandas with the import statement for FireDucks. More
FireDucks shows high performance gain while executing various queries included in the TPC-H and TPCx-BB benchmarks. More.
Use Cases
From Users
From Developers
Have you ever thought of speeding up your data analysis in pandas with a compiler?
In general, a Data Scientist spends significant efforts in transforming the raw data into a more...
ReadEstimate the number of groups and group by
We are pleased to introduce about acceleration technology inside FireDucks.
ReadThe import hook feature
We are pleased to introduce how to use FireDucks without modifying your existing programs at all.
Read