Havoc7 hours ago
These sort of things always seem to assume a fairly relaxed software environment.
In practice I’ve found the big corporates try hard to keep their excel files with financial data and their Python environments with pip & all those associated risks far apart. That’s if pip works at all & isn’t caught by a firewall
khurs7 hours ago
Most corporates, last I knew, didn't use Python outside of IT. Devs outside of IT would be using VBA.
However in Financial companies, Python and Excel have always been used together by devs and also quants.
And they tend to use Anaconda, and also like all their other package managers, they would host an in-house package repository and block the public one. That way only approved packages are used, and they only update packages as needed.
Many though have a policy of minimising Excel and rolling out formal platforms whether in-house or off the shelf, as Excel is regarded as a ongoing risk of in-accuracy as full editable at all times, lack of git/version control and so on.
evanjrowley2 minutes ago
>Many though have a policy of minimising Excel and rolling out formal platforms whether in-house or off the shelf, as Excel is regarded as a ongoing risk of in-accuracy as full editable at all times, lack of git/version control and so on.
Can confirm this practice in place at fortune 50 financial institutions. One in particular calls it "End-User Computing System Risk", meaning the end user created a business-critical "system" (i.e., a complex Excel file or Access database) on their own computer.
janlaureys6 hours ago
Been working on a dashboard that takes in a bunch of different public data sources in different formats and pandas has truly been a godsend for this.
I've got csv, txt, xlsx in all different shapes and sizes and with just a few settings I can go through them quite easily and very fast as well.
OGWhalesan hour ago
Depending on the size and the transformations you are doing, polars is worth checking out. Syntax is a bit different from pandas but the performance is really nice.
janlaureys44 minutes ago
My biggest bottleneck right now is upload speed but I'll keep it in mind thanks.
fomoz39 minutes ago
[dead]
rantingdemon2 hours ago
This is just an advertisement for a book. And a terrible advertisement. No sample chapters to evaluate the book.
jenkinstriggeran hour ago
Yeah, a $50 book (physical) or $40 ebook
pbronez2 hours ago
Yes it’s an add for a book but it does provide a sample chapter:
https://nostarch.com/download/samples/automate-excel-with-py...
delis-thumbs-7e6 hours ago
Looking at the content, if you are familiar at all with Python and basic programming, this provides very little new. I sometimes have to stuff massive Excel-abominations with 50k+ rows and rip data I need out of them with Pandas, but it only requires reading Pandas documentation (which is very good) a bit.
But perhaps this might be good if you know no programming and want to make your life easier.
snickmy3 hours ago
in a world of ai agents, python is just an implementation detail that you don't need to know, between you and your data/business task
My_Name34 minutes ago
"Stop wasting your time on Excel and waste even more coding an Excel parser in Python!"
rrgok5 hours ago
I prefer DuckDB
tokai4 hours ago
How do you automate Excel with a RDBMS?
psd136 minutes ago
DuckDB isn't an rdbms, bit the answer is the same: ODBC or OLAP. There's a "data connection wizard".
fomoz36 minutes ago
[dead]
cm21876 hours ago
Terrible title. Nothing to do with automating excel. From what I can tell it seems to be about ingesting spreadsheets into panda (and incredibly narrow use of Excel) and working outside of Excel.
ebeirne25 minutes ago
its just a really badly written ad
pbronez2 hours ago
What are best practices for using Excel as a front end for python tooling? I’ve got a use case where the business users are maintaining a complex spreadsheet and we need to hook some genuine optimization into it. It’s all fine and good if you assume the people will use the template perfectly, but hahahahahaha
There’s probably some ideal blend of locking regions, in-excel validation, in-python validation, and clean separation of human inputs and machine outputs. Has anyone figured out what that is already?
fomoz18 minutes ago
[dead]
bluecomputing6 hours ago
[dead]