If you're working with data pipelines, these repositories are very useful: ππ
ibis: A Python API that allows you to write queries once and run them on different data backends, such as DuckDB, BigQuery, and Snowflake. ππ
https://github.com/ibis-project/ibis
pygwalker: Instantly turns a DataFrame into an interactive UI for visual data exploration. ππ₯οΈ
https://github.com/Kanaries/pygwalker
katana: A fast and scalable web crawler, often used for security testing and large-scale data collection/search. π·οΈπ
https://github.com/projectdiscovery/katana
#dataengineering #python #opensource #devtools #dataviz #security
Post #9521
1.95K
- β€ 4