Working with a large 3rd party product feed coming into our Miva store, I have setup some server-side cron jobs to manage the import process.
Basically, after some segregated DB tables are made to manage info regarding the feed items, I have an API call created for each product being pulled in to either update the SKU's info in Miva or to insert a new product. There is more going on than just the one API call per product - new items require another call to capture its' newly made Product_ID to then assign images, etc.
With nearly 7k SKUs that get updated or created - or deleted near the end of the process - that's a lot of API calls.
Would grouping Product_Update and Product_Insert calls be more efficient? Is there a limit to the call size for the JSON API?
If I were to group these requests, the standard Product_Update API could have nearly 6k+ iterations. My common sense tells me this is excessive (probably close to 50MB of data), but can the API handle this or is there a better way?
Also, running API calls/responses in a per-item method takes a fair bit of time - hours. Which is no good. :/
Basically, after some segregated DB tables are made to manage info regarding the feed items, I have an API call created for each product being pulled in to either update the SKU's info in Miva or to insert a new product. There is more going on than just the one API call per product - new items require another call to capture its' newly made Product_ID to then assign images, etc.
With nearly 7k SKUs that get updated or created - or deleted near the end of the process - that's a lot of API calls.
Would grouping Product_Update and Product_Insert calls be more efficient? Is there a limit to the call size for the JSON API?
If I were to group these requests, the standard Product_Update API could have nearly 6k+ iterations. My common sense tells me this is excessive (probably close to 50MB of data), but can the API handle this or is there a better way?
Also, running API calls/responses in a per-item method takes a fair bit of time - hours. Which is no good. :/
Comment