Become a sponsor to Nick Poorman
Thanks for considering being my sponsor. A large part of my time is dedicated to building open source tooling around data and event architectures. I have experience with growing engineering organizations, large customer data platforms, machine learning, and even craft beer. I've dug deep into Apache Arrow Project and event architectures.
Now my goal is to make SaaS developers and data engineers more productive by solving hard problems and providing a lot of what is re-invented with every new project.
Here are a few of my recent open-source projects in the areas I've been focusing on. Your support encourages me to continue dedicating time on improving them.
- https://github.com/hyperscalr/fallbaq - A distributed, clustered, replicated log and queue service with security, retries, and back-off capabilities. I am dedicating the majority of my efforts to this and am now working on it full-time.
- https://github.com/gomem/gomem - Data tooling for Apache Arrow in Go - including a DataFrame implementation
- https://github.com/nickpoorman/pytasks - Run Python inside a Go process (ooohhhh ahhhhh)
- https://github.com/nickpoorman/go-py-arrow-bridge - Share pointers directly between Apache Arrow buffers between Python and Go - i.e. Manipulate data in Python and then do things with it in Go without having to serialize it over the language boundary. This way you can use Go and continue to use your favorite data science libraries in Python.
- https://github.com/pantry-io/pantry - A horizontally scalable, disk persisted, the no-worry solution to dealing with high-volume event streams. Think Kafka but without the bloat. Read more about it here p1 and here p2.
I recently started @Hypersclar to fully dedicate my efforts towards building these projects out. Please feel free to reach out if you have a need for anything these tools are not currently providing.
Thank you so much for considering sponsoring my open source and community work. Your contribution, whichever tier, means a lot. I'm going to continue finding ways of making developer's and data engineer's lives easier by solving hard problems that often get overlooked (tight deadlines?). If there are any problems you are facing that you think I could help solve around data and/or event systems, please feel free to ping me (nick @t hyperscalr.com)! Thanks again, please stay in touch.
Featured work
-
apache/arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
C++ 14,661 -
gomem/gomem
Various packages for working with Apache Arrow in Go, including a DataFrame implementation.
Go 26 -
nickpoorman/go-py-arrow-bridge
Bridge between Go and Python to facilitate zero-copy using Apache Arrow
Go 18 -
pantry-io/pantry
A simple to maintain background job and message queue service. https://nickpoorman.com/2020-07-26-data-pipelines-part-2-retries/
Go 6 -
nickpoorman/pytasks
Python task execution in Go
Go 2