Cannot use dates before 1969-12-31 12:00:00 (i.e. negative epochs < -43200) in partitions on Windows about dagster HOT 5 CLOSED

cc @smackesey if you've run across this before or have any ideas? @gibsondan you've also been looking at pendulum stuff recently right?

From what I can find through searching around, pendulum claims to have fixed this in sdispater/pendulum#53, but it was part of the 0.6.2 release in 2016, so you should definitely have that code.

Other libraries that ran into the same issue, seem to write custom code to special case negative time on windows:

This PR from py-arrow uses timedelta if the date is negative and the OS is windows

Another example from faker joke2k/faker#1436

from dagster.

IIUC @gibsondan has a PR that removes pendulum entirely so hopefully that will make this issue moot

from dagster.

We are going to remove pendulum, but we will still be using UNIX timestamps after that, so I'm not positive that will resolve this.

from dagster.

It's possible that the workaround suggested here could resolve this, but I have not tried it: https://stackoverflow.com/questions/37494983/python-fromtimestamp-oserror/41400321#41400321

from dagster.

yeah, after some internal discussion, this is something we aren't going to try to fix. We assume we can use unix timestamps all over our code base, so trying to work around this issue is infeasible at the time. Closing this issue

from dagster.