High-Throughput Multi-Format Drilling Data Export Console

1. High-Performance Telemetry Streaming & Data Integration

Modern high-frequency drilling telemetry logged at 1 Hz (1 sample per second) produces 86,400 sensor records every single operational day. Transferring these massive datasets into third-party reservoir modeling platforms, petrophysical suites, machine learning pipelines, or client databases often causes software lockups, memory exhaustion, or format incompatibilities.

The WDA Data Export Console (accessed directly from the analysis toolbar via the Export Data feature) provides an asynchronous streaming extraction engine designed to export millions of telemetry rows cleanly to disk without freezing the user interface. Powered by dedicated background thread-pool workers, WDA streams high-frequency time data and depth-indexed logs across six industry formats with automated calendar partitioning, on-the-fly unit conversion, and driller annotations merging.

2. Six Industry-Standard Export Formats

WDA includes specialized, low-allocation streaming writers tailored for specific downstream engineering environments:

• Microsoft Excel (.xlsx):

  Generates native OpenXML spreadsheets with formatted header styling, auto-filter dropdowns, and frozen header rows. Uses automated 86,400-row partitioning to ensure spreadsheets never exceed Microsoft Excel row limitations.

• CWLS LAS 2.0 / 3.0 (.las):

  Full compliance with the Canadian Well Logging Society (CWLS) Log ASCII Standard. Automatically writes standardized ~VERSION, ~WELL, ~CURVE, ~PARAMETER, and ~ASCII LOG DATA sections, guaranteeing instant compatibility with Schlumberger Techlog, Halliburton Landmark, and petrophysical viewers.

• Apache Parquet (.parquet):

  Columnar binary format equipped with dictionary encoding and Snappy compression. Reduces on-disk file size by 80% to 90% compared to raw CSV while enabling blazing-fast vectorized ingestion into Python (Pandas/Polars), R, and cloud AI lakehouses.

• Comma-Separated Values (.csv):

  RFC 4180 streaming writer with culture-invariant formatting, quoted strings, and clean null handling for universal relational database loading.

• Tab-Separated Values (.tsv):

  High-speed tab-delimited stream with zero quote overhead, ideal for UNIX shell pipelines (awk, cut, sed) and database bulk-copy utilities.

• Split-Oriented Matrix JSON (.json):

  Engineered to match pandas.read_json(..., orient='split'). Separates column arrays, indices, and numerical matrices to reduce JSON payload size by up to 75% compared to bloated record-based JSON.

3. Intelligent Partitioning & the 86,400-Row Standard

A 1 Hz drilling telemetry stream generates exactly 86,400 samples every 24 hours ($24 \times 60 \times 60$). Ingesting weeks of continuous drilling into a single multi-gigabyte flat file crashes desktop applications. WDA prevents this through an automated Dual-Partitioning Strategy:

• Calendar-Day Splitting (Full Channelsets): Automatically breaks multi-week drilling runs into individual 24-hour UTC calendar day files (e.g., WellA_TimeData_2026-10-15.csv). Guaranteed to contain $\le 86,400$ rows per file, perfectly aligned for daily archival and vendor handoffs.
• Sequential Chunking (Filtered Queries): When exporting a custom-filtered interval, large query streams automatically segment across sequential chunks (e.g., Part01.xlsx, Part02.xlsx) whenever records exceed 86,400 rows.

4. Dynamic Unit Conversion & Comments Merging

• On-the-Fly API RP 66 Unit Conversion:

  Select any target Unit Profile (Imperial, Metric, SI). WDA dynamically converts pressure, weight, torque, and depth values during file streaming without modifying the underlying database measurements.

• Flexible Column Naming & Deduplication:

  Toggle with one click between terse engineering mnemonics (e.g. DBTM [m]) and full descriptive labels (e.g. Depth Bit (meas) [m]), with automatic deduplication preventing duplicate unit suffix errors.

• Drilling Comments Synchronization:

  Chronologically match annotations from the well Message table directly onto telemetry timestamps. Geoscientists inspecting exported logs can read driller comments, bit changes, and formation tops alongside physical sensor values.

• Temporal Decimation / Downsampling:

  Downsample dense 1-second telemetry to 5-second, 30-second, or 5-minute averages, reducing output size by up to 99% for high-level management overviews.

5. Related WDA Engineering Modules

• WDA: WITSML Compatible Data Analyzer: Discover WDA's high-speed architecture and integrated wellbore tools.
• Offline WITSML Ingestion Engine: Ingest historical WITSML 1.3, 1.4, and 2.0 files into WDA before exporting.
• Time-Based Analysis Console: Filter and inspect raw sensor streams before initiating export.
• Depth-Based Log Analysis & Petrophysics: Export converted depth curves directly into CWLS LAS 3.0 files.