[{"data":1,"prerenderedAt":135},["ShallowReactive",2],{"article-cargowise-data-extraction-preview":3},{"id":4,"title":5,"author":6,"body":7,"category":117,"description":118,"extension":119,"featured":120,"image":121,"meta":122,"navigation":123,"path":124,"publishedAt":125,"readingTime":126,"seo":127,"stem":128,"tags":129,"videoUrl":133,"__hash__":134},"articles\u002Farticles\u002Fcargowise-data-extraction-preview.md","Getting Clean Data OUT of CargoWise Is Harder Than Putting It In","Don Dappa",{"type":8,"value":9,"toc":111},"minimark",[10,19,24,31,37,59,81,87,91,97,100],[11,12,13,14,18],"p",{},"Most eAdapter writing is about pushing data ",[15,16,17],"em",{},"into"," CargoWise. Then someone asks for a revenue report, a visibility feed, or a migration export — and you discover the extraction side has its own trap list.",[20,21,23],"h2",{"id":22},"the-extraction-traps","The extraction traps",[11,25,26,30],{},[27,28,29],"strong",{},"Native XML queries don't paginate."," A wide date range returns everything at once — several megabytes in one response — stalling both the transfer and your parser. Narrow every query (one month max, status filters) and cap the clock — past roughly 50MB, CW may silently truncate the response. When it does, your report is missing rows and nothing tells you.",[11,32,33,36],{},[27,34,35],{},"Query endpoints need timeout budgets more than push endpoints."," The 15-second budget on bulk queries in our production integration exists because an un-timeouted call hands your entire serverless wall-clock to CW's slowest day.",[11,38,39,46,47,50,51,54,55,58],{},[27,40,41,45],{},[42,43,44],"code",{},"select('*')"," thinking doesn't work on CW responses."," Job numbers live in ProcessingLog text that speaks three verbs (",[42,48,49],{},"Updated",", ",[42,52,53],{},"Added",", and ",[42,56,57],{},"[Pending Change] Updating",") — miss one and your extraction silently drops data.",[11,60,61,64,65,68,69,72,73,76,77,80],{},[27,62,63],{},"Dates are in UTC — sometimes."," Fields ending ",[42,66,67],{},"Utc"," (",[42,70,71],{},"P9_ActualDateUtc",") are UTC; fields ending ",[42,74,75],{},"Local"," or with no suffix may be in the creating user's local time. Convert at the presentation layer via IANA zones (never UTC offsets — they change with daylight saving), keyed off a UN\u002FLOCODE→timezone lookup for port-based reporting. An arrival at 23:40 UTC is ",[15,78,79],{},"tomorrow"," in Dubai, and every date-grouped report crosses that line somewhere.",[11,82,83,86],{},[27,84,85],{},"Charges contain things you didn't put there."," CW's rating engine generates charges automatically — including the DOM-CWAF automation fee on every invoicing job. If you extract charges, you need a policy for lines your integration never created.",[20,88,90],{"id":89},"what-vol-3-covers","What Vol 3 covers",[11,92,93,96],{},[15,94,95],{},"Data Extraction & Reporting"," — the third volume of the CargoWise eAdapter Series — is next in the series. It will cover query formats and their limits, mapper architecture with source-tracking columns, protecting extracted data from being overwritten, and building reporting pipelines that survive CW upgrades.",[98,99],"hr",{},[11,101,102,105,106],{},[27,103,104],{},"Own Vol 1 or Vol 2?"," Waitlist members get first access and early-bird pricing — and when Vol 3 ships, the bundle (all three volumes, Vol 1 free) goes live the same day. ",[107,108,110],"a",{"href":109},"\u002Feadapter\u002Fdata-extraction?channel=article_vol3preview","Join the Vol 3 waitlist →",{"title":112,"searchDepth":113,"depth":113,"links":114},"",2,[115,116],{"id":22,"depth":113,"text":23},{"id":89,"depth":113,"text":90},"technical","Native XML queries with no pagination, multi-megabyte responses, silent truncation, and UTC dates in disguise — the extraction traps, and what Vol 3 of the eAdapter series will cover.","md",false,"\u002Fimages\u002Farticles\u002Fcargowise-data-extraction.webp",{},true,"\u002Farticles\u002Fcargowise-data-extraction-preview","2026-09-02",4,{"title":5,"description":118},"articles\u002Fcargowise-data-extraction-preview",[130,131,132],"CargoWise eAdapter","data extraction","Native XML",null,"acvH45bVfaUGlBvCj0HxUg2qWc2QMxaegA4Nn_ZsXmc",1788800213410]