bramkn / n8n-nodes-iterator Goto Github PK

Hi @bramkn, It seems that the "Is there another page" option is being referenced on the first run. It looks to me like my workflow fails because the set node that contains the data after the first run is not executed.

Could it be the expression? My concern is that it could happen that the last set of items returned is exactly as much as would trigger the next run, so I check for an empty or undefined value.

I'm trying to set this up to use with the HubSpot API, which uses an offset for paging. The initial request is passed through iterator to the looped request, but no subsequent requests pass and it exits after the first pass.

What am I missing here?

Because the value is checked from the first iteration it results in unwanted behavior.
You cannot simply check the next page if it exists, as it will not exists for the first iteration.
You can work around this with a set node for example, but that's a hassle.
will be fixed some day.

Iterator sends empty next page to the HTTP module when the next page does not exist and we get an error that the link does not exist and the HTTPS model cannot handle the request.

Result contains 2 pages, The script gets stuck when the iterator keeps sending an empty value to the HTTP module instead of checking if it exists or not (and sending the results to Done).

Iterator parameters

2nd page (Iterated)

Parameters
Iterator Module - Reference Start: https://xxx/api/v4/events?filter[created_at][from]=1666795337&filter[created_at][to]=1666795338&limit=100
Iterator Module - Reference Next (Taken from a HTTP module): {{$node["HTTP Request"].json["_links"]["next"]["href"]}}
HTTP REQUEST MODULE - {{$node["Iterator"].context["currentReference"]}}

What should I do so that it collects all the values and sends them to Done, as is done in the example:
https://community.n8n.io/t/new-community-node-iterator/17741

Thanks for the help, I think we can get a very powerful tool by fine-tuning the module, I have 200,000 records and they are processed 100 at a time, such a method would make the task a lot easier.