Comments (1)
skanthed
commented on September 25, 2024
To maintain the list of all files that are being pushed to S3 we have one history.txt file in the bucket which keep track of all the file that is being pushed.
But we know as S3 bucket maintains its own audit. So, we need to do more research that can we access logs and perform our operations.
from curator.
Related Issues (20)
- Re-deployment postgresql database to support table partitioning HOT 4
- Fix database incompatibility with Superset
- Investigate failure and log error properly HOT 3
- Remove unnecessary try-except blocks
- Improve logging
- Data recovery from S3 HOT 4
- Identify the timeframe for logging HOT 1
- Demo - Infra Utilization in Operate First HOT 4
- Polish reports and produce usage as percentage HOT 5
- Remote shell failure in Curator cluster HOT 4
- Email report missing header
- Report generation timing issue HOT 4
- Create a doc that has the list of features that need to be tested HOT 4
- Define a PRD and get it approved by the cost management PM HOT 7
- Create a document on requirement to build an operator. HOT 8
- Unit test cases to cover features HOT 4
- Automation of daily sanity checks. HOT 4
- CI pipeline should be introduced to the development. HOT 4
- Documentation, demo, and reports should be updated during every release. HOT 5
- Learning - Build a 'Hello World' Operator HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from curator.