Support Per-Resource Pagination in Ocean Custom Integrations
B
Ben koth
Problem
Ocean currently supports pagination
only at the integration (global) level
. Pagination blocks defined under individual resources in port-app-config.yml
are ignored at runtime. This prevents passing resource-specific parameters as:- * limit
- * cursor_path
- * has_more_path
- * page_size
- * param
Some APIs (e.g., Anthropic Usage API) default to returning a single record unless
limit
is explicitly provided. As a result, Ocean ingests incomplete datasets.Requested Capability
Enable pagination configuration at the
resource level
, allowing each resource to define its own:- Pagination type
- Page size / limit
- Cursor handling
Resource-level pagination should override global settings when defined.