How can I reduce the load on my DB connection?
Question Description:I am seeing a very high load spike on my DB connection whenever a Y42 orchestration is running and pulling a lot of data.
Answer:
Things you can do
1. Ensure that you are only using incremental imports
2. If you have multiple orchestrations that are pulling from the same Database, ensure that they are started at slightly different times so the imports don't overlap
3. If there are a lot of imports inside one orchestration, you can change the structure of the orchestration to chain the imports. If you chain one import to another, it means that the second one will only start after the first one finishes. This will reduce the spike load on your DB
4. You can work with a read-replica of your database which will ensure that your production DB is not affected
Was this article helpful?