The problem in oil and gas has never been the amount of data. It's whether anyone believes it.
Eric Fidler told us a story on Wisdom at the Wellhead that I haven't been able to shake. He was working on converting a major drilling OEM to Rockwell, and the whole team took the corporate plane from Houston up to Cleveland. End of the day. You'd figure a few adult beverages might flow on a flight like that. But the engineers got on that plane carrying a stack of paper this thick. They'd had an event on a rig that afternoon, and they were going to pick through the data by hand to figure out what happened. It took them two and a half hours.
Two and a half hours. On a plane. With paper. Not because they didn't have systems. Not because somebody forgot to install the software. Because they trusted the paper more than they trusted the screen.
That image has stayed with me because I've lived some version of it for most of my career. I've been the guy who pulled his own numbers because the report didn't match what I saw in the field. I've sat across from engineers at Total Stream who told me flat out that they run their own spreadsheet on the side because they can't rely on what the system gives them. And every time I hear that, I know the problem isn't the technology. The problem is the data behind it hasn't earned anyone's trust yet.
Reams and Reams and Nobody Knows What to Do With It
We asked Eric directly. What's the biggest challenge companies are struggling with right now, regardless of size? He didn't hesitate. They've got reams and reams of data they don't know what to do with.
Then he said something that hit harder. He said you can ask any CEO of an oil enterprise whether they see value in their data. They know they have a lot of it. They just don't understand what to do with it. And that confusion doesn't stay in the corner office. It filters down through the entire organization. The production manager doesn't trust the reports. The field supervisor sticks with what he's always done. The pumper writes things down by hand because at least he knows what he's looking at.
None of those people are being stubborn. They're being rational. When the official system hasn't proven it can give you the truth every time, you build your own safety net. Handwritten logs. Side spreadsheets. Paper on a plane. That's not resistance to technology. That's a perfectly reasonable response to technology that hasn't earned its place yet.
The Pilot That Proved the Wrong Thing
Eric said the successful scaling rate for digital pilots in this industry is "ridiculously small." I've watched enough of them come and go to know he's right. And the pattern is always the same.
A vendor shows up with a promising tool. They run a proof of concept on a handful of wells. Controlled conditions. Clean data. The demo looks great. Everybody in the conference room nods. And then nothing happens. The pilot sits in a folder somewhere. The field goes back to doing what it was doing before. And six months later somebody mentions it as one of those things we tried.
I used to think that was a sales problem. The vendor didn't follow through, or the company wasn't committed enough. But after watching it happen over and over, I've come to believe the real failure is simpler than that. The pilot proved the technology worked. It didn't prove the data was real.
That's the distinction nobody wants to talk about. A demo under controlled conditions proves the software can do what it claims. But the moment it hits a real field with real operators and real pressure, the cracks show up. A timestamp doesn't match what the pumper saw that morning. A sensor reads one thing while the gauge on the wellhead says another. A number in the dashboard doesn't square with what the foreman knows from thirty years of walking that lease. And just like that, trust is gone. The paper comes back out. And all the computing power in the world can't put it away again.
Structure Before Dashboards
I've always told people, it's okay to be creative with the data you use to find better solutions. But it's not okay to be creative with the structure in which that data hits. That structure is everything. If you get the architecture wrong, it doesn't matter how much data you collect or how pretty the dashboard looks. You've built a nice house on a bad foundation, and everybody living in it can feel the floors creak.
This is where I've spent a big chunk of my career at Total Stream, and honestly it's the part most people want to skip past. They want the analytics. They want the dashboards. They want the AI. But when I ask them to show me their data architecture, they look at me like I just asked to see their taxes. Nobody wants to do that work. It's not exciting. It doesn't demo well. But it is the only thing that makes everything else trustworthy.
That's a big part of why we partnered with Sensia. Their vision for how data has to flow matches ours. When you bring SCADA data through Sensia's Avalon platform into a structured data warehouse in real time, you're not just collecting information. You're positioning it so an engineer can actually use it the moment it matters. You're taking care of that itch every production engineer has, the one that says, "I don't want to spend 90% of my time chasing data. I want to do the work I was hired to do."
But that only works if the data is right at the source. If the foundation is clean. If what the screen shows matches what the operator sees when he walks the lease. Skip that step, and you're just giving people a fancier version of something they already don't believe.
How Trust Actually Gets Built in This Business
Eric made a point about reaching mid-market operators that I think is dead-on. These are the companies watching their nickels and dimes. They can't afford to waste money on a pilot that doesn't go anywhere. So how do you get them to trust something new?
He said you have to find where they're going to learn what they need, and you have to be there. Small local industry events. Desk time. Legwork. You do enough of that work with somebody who's growing by acquisition, and they write you into the next deal. Not because of your pitch deck. Because they've seen you show up.
And then he confirmed something I've believed my whole career. When you win one or two, you get them to talk about you. Because in this industry, you almost have to create the situation where a guy looks across the road and says, "See, that guy did this and I didn't, and look how much further he is than me." That's what moves people. Not features. Not specs. Results from somebody they know. Word of mouth goes a long way in the oilfield. It always has.
I've watched this play out at Total Stream for years. The best customers we've ever landed didn't come from marketing. They came from another operator picking up the phone and saying, "You should talk to these guys. Here's what changed for us." That's trust. And no amount of advertising can manufacture it.
Final Thought
I keep coming back to those guys on the plane. A rig event happens. They've got data systems available to them. They've got software that's supposed to give them answers. And they grab a stack of paper three inches thick and spend two and a half hours picking through it by hand. Because the paper doesn't lie to them. The paper is the thing they've tested against reality enough times to believe.
That's not a technology problem. That's a trust problem. And you don't solve trust problems by adding more technology on top of data nobody believes. You solve them by getting the foundation right. By making the information accurate at the source. By proving it matches the field, every time, under real conditions. By showing up when it breaks and fixing it instead of disappearing.
The day an engineer gets on a plane after a rig event and opens the laptop instead of reaching for the paper, that's the day you know the data trust gap is closed. We're not there yet. But the path is clear. Get the structure right first. Earn trust small before you promise it big. And never forget that the person who has to stake a decision on what your screen tells them has every right to demand that it be true.
Eric Fidler has watched digital pilots succeed and fail across every kind of operation, from mid-market independents to global producers. On Wisdom at the Wellhead, he lays out exactly why the scaling rate is so low and what has to change at the data level before the industry stops carrying paper onto planes.