Offline Time-Based WITSML Ingestion Engine (v1.3.1.1, v1.4.1.1, v2.0)

1. High-Performance Offline WITSML Data Ingestion

The Offline WITSML Ingestion Engine in WDA (accessed directly from the Databases Explorer tree by right-clicking any Channelset and selecting Import WITSML Data, or via the Workflow Wizard) is an enterprise-grade, non-blocking data parser engineered to process large archives of historical drilling and logging files. Designed specifically for subsurface teams dealing with multi-gigabyte folders of historical well data, this engine parses XML logs adhering to WITSML 1.3.1.1, WITSML 1.4.1.1, and Energistics WITSML 2.0 specifications without requiring external web services, ETP connections, or third-party schema compilers.

While real-time streaming tools rely on live rig telemetry links, post-drilling analysis, formation evaluation, and regional well correlation depend heavily on historical XML data archives. WDA's streaming parser decodes delimited ASCII curves directly from <logData> and <ChannelData> elements, bulk-inserting tens of thousands of telemetry rows per second directly into local, column-compressed analytical database tables.

2. Universal Multi-Version WITSML Support (1.3, 1.4, 2.0)

Different service contractors and operators generate files across varying WITSML standards. WDA solves compatibility bottlenecks through a universal, schema-agnostic parser that automatically inspects namespace declarations and schema attributes:

• WITSML 1.3.1.1 Historical Logs:

  Full support for classic legacy time and depth logs. Parses comma, space, and tab-delimited arrays nested within <logData> blocks, mapping curve mnemonics, units of measure, and data types seamlessly.

• WITSML 1.4.1.1 Industry Standard:

  Comprehensive ingestion of 1.4.1.1 log, channelSet, and trajectory objects. Automatically resolves curve indexing, start/end timestamps, and null value representations.

• Energistics WITSML 2.0 Common Data Architecture:

  Native compatibility with modern WITSML 2.0 modular architectures. Directly handles UUID citation linking, <ChannelSet> containers, and streaming data points embedded in <ChannelData> arrays.

3. Key Advantages of WDA Offline Ingestion

• Asynchronous Non-Blocking Execution:

  The ingestion pipeline runs on dedicated background worker threads. The user interface remains completely fluid, allowing engineers to inspect other wells, modify plots, or configure reports while millions of records stream to disk.

• Automated Null-Value Filtering:

  Sensors denote out-of-hole intervals or missing values using sentinel codes (e.g. -999.25, -9999). WDA extracts the <nullValue> tag from curve headers and maps matching data to database NULL, eliminating false graphical anomalies and chart scaling distortions.

• Live Diagnostic Console & Metrics:

  Monitor active ingestion throughput with live metrics: Elapsed Time, Insertion Speed (rec/s), Processed Files, and Success/Error Tallies. An embedded monospace diagnostic console streams curve header resolutions in real time.

• Transaction Integrity & Graceful Abort:

  You can halt batch imports at any moment with the Stop button. WDA cleanly commits the active file's transaction without corrupting the local database or losing previously imported logs.

4. Step-by-Step Batch Ingestion Workflow

1. Select Target Wellbore & Channelset: In the Databases Tree, navigate to your target Wellbore and right-click the destination Channelset. Select Import WITSML Data.
2. Scan Source Directory: Browse to the local or network folder containing historical WITSML XML files. Click Scan Folder to discover and chronologically sort all matching files into the queue.
3. Start Ingestion: Click Start Import. WDA parses curve arrays, maps mnemonics to channel definitions, and streams telemetry into database tables at up to 50,000+ records per second.
4. Proceed to Analysis: Once imported, launch Time Analysis, convert data using the Time-to-Depth Engine, or export formatted sets via the Data Export Console.

5. Related WDA Engineering Modules

Once your raw WITSML telemetry is ingested, leverage WDA's interconnected tool suite to maximize data value:

• WDA: WITSML Compatible Data Analyzer: Explore WDA's high-performance 60 FPS graphics and columnar engine architecture.
• Time-to-Depth Conversion Engine: Reconcile bit depth and hole depth to generate uniform petrophysical depth grids.
• Data Export Console: Export validated WITSML curves to Excel, CWLS LAS 2.0/3.0, Apache Parquet, or JSON.