Skip to content

Event Data cursor error

Background

A user has reported being provided a cursor that leads to an error.

Observed behavior

The query being carried out is: http://api.eventdata.crossref.org/v1/events?from-collected-date=2019-01-29&until-collected-date=2019-03-21&rows=1000

the following query fails:

http://api.eventdata.crossref.org/v1/events?from-collected-date=2019-01-29&until-collected-date=2019-03-21&rows=1000&cursor=f4a1faf0-744e-4dee-86f5-110c4439915f

with the output:

{ "status": "failed", "message": "An internal error occurred. If you see this message repeatedly, please contact us." }

the cursors preceding this one were:

  • 51e980a7-241e-4d76-8549-c91a57314cdf
  • dc2ddb8b-f258-4213-82ca-cc6c79fc10a0
  • 64479b8e-3c56-44f3-b656-42fc6ae5512e
  • 433beb44-b923-4118-a3a4-cda8afbda4fa
  • f7f1dc17-3db9-4b83-aa78-5a52f01d21da
  • 2482ce8b-8c4c-46c3-a415-29b15c642e68
  • 42b4475f-6291-4804-ac9e-334c48b40008
  • bf41491f-e9cb-4459-9098-d24d54c205e9
  • 81453b63-0f7a-4f32-85a7-2d3e1dff26ba
  • f4a1faf0-744e-4dee-86f5-110c4439915f

The first 9 in this list work, and the penultimate one provides the failing cursor.

Expected behavior

Cursors provided in Event Data output should be valid and lead to the next page of results.

How urgent

I will provide the user here access to the data dumps we put together last year, so it is not urgent to fix, however there is clearly an issue here that needs investigating. It could be a useful case to rerun after a switch to a new server infrastructure.

Definition of ready

  • Product owner: @mrittman
  • Tech lead: @ppandis
  • Service:: or C:: label applied
  • Definition of done updated
  • Acceptance testing plan: check output of the failed query above
  • Weight applied

Definition of done

  • Unit tests identified, implemented, and passing
  • Code reviewed
  • Available for acceptance testing via a staging URL, or otherwise
  • Consider any impacts to current or future architecture/infrastructure, and update specifications and documentation as needed
  • Knowledge base reviewed and updated
  • Public documentation reviewed and updated
  • Acceptance criteria met
    • Investigate cause of failed query
    • Fix to provide the next page of results.
  • Acceptance testing passed
  • Deployed to production

Notes

Edited by Patrick Polischuk
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information