Comments (9)
/cc @ryanbrainard @dcarroll @quintonwall
What can we do to export such a large org? Can the export be paginated somehow?
from force.
For what it's worth, I'm just trying to get the metadata for one SObject.
from force.
Are you looking for the XML metadata? Do you want to use it externally or run it back through force import
?
from force.
Run back through force import. The enhancement I'd like to work on (if I am able to rebuild the project) is to look at permissions (OLS, FLS) and harmonize them.
from force.
That sounds great. I'd be happy to answer any questions you have along the way.
Let's leave this issue open to track the LIMIT_EXCEEDED
error because it seems like a legitimate problem for large orgs. If you'd like to create another issue/pull request to track your enhancement we can discuss there.
from force.
TLDR: Don't try to solve within this tool
This is a general salesforce problem and should be solved at that level. Salesforce doesn't provide a pagination option as of now, but the other tools that deal with this pull subsets of the metadata types per request and merge into the final full directory structure on disk. The issue is that you need to have a backoff retry mechanism to get under LIMIT_EXCEEDED, but each async request takes time and you could be waiting a while. The other bigger issue and the reason salesforce needs to solve for it is because the metadata could change between requests, and you end up with an inconsistent full metadata set.
This problem is only going to get worse with this tool. The barrier to entry to create metadata has been reduced with this tool, which leads to experimentation / more metadata (which is great), and users most likely won't clean up. At the point they decided to provide a file representation of the metadata sitting in a database, they should've considered this. The full metadata state of any org should be able to be downloaded as an archive file at any time.
from force.
You are correct, the metadata api is not intended to get everything. It is why there are "on platform" ways to cut a sandbox, create change sets and so on. This kind of tool, and the usefulness of it, were not anticipated. I will gladly relate a request for pagination or some other strategy for getting the full set of metadata, through apis, to the engineering team.
from force.
Has there been any progress on this API limit pagination idea?
from force.
Merging the profiles after multiple exports should be feasible. See https://github.com/ForceCLI/force-md/blob/b8b2154b3bc6f28302cdbfeb990126bb47e597f4/cmd/profile/merge.go#L40
from force.
Related Issues (20)
- `force push -t AuraDefinitionBundle -n <SOME_COMPONENT>` fails, tries to push unrelated metadata HOT 1
- “fatal signup error” when creating scratch org HOT 1
- Wrong Options Must Throw Error HOT 2
- queryAll in BULK mode HOT 4
- `force push` documentation is incorrect HOT 1
- does force cli can pull metadata in source(dx) format? HOT 1
- force query -f csv UTF- 8 issues HOT 4
- Is it a big change to stupport Salesforce DX project structure? HOT 1
- Can i change the batch size when bulk upsert HOT 2
- Pushing AuraDefinitionBundle by type does not filter by name HOT 1
- lib/log logs everything as error HOT 1
- "force whomai(whoami)" typo on the https://github.com/ForceCLI/force page. HOT 1
- CLI: unexpected end of json input HOT 2
- source:retrieve issue HOT 2
- After logging in : "ERROR: Please login before running this command" HOT 2
- force:org:create: A fatal signup error occurred - org creation issue HOT 1
- Cannot seem to insert a carriage return line feed (CRLF) into a text area field HOT 5
- ForceCLI is not exporting "StandardValueSet". Why?
- Force Fetch Layouts returning an error but succeeding HOT 1
- Force Fetch should ignore file extensions and not error out HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from force.