Avoid a mess, clean your data
The hidden time and financial costs before even using a spend-analysis program can be a thorn in your side—it pays to be prepared.
By Maria Varmazis -- Purchasing, 3/1/2007
| Read more in this software series
PLM gets buyers under the hood Basics of the software buy 5 'musts' for justifying IT budgets |
Ken Hartman's tale is a cautionary one to anyone about to dive into the world of spend-analysis software. Hartman, the manager of global sourcing and indirect at Natick, Mass.-based Boston Scientific, says that he and his team "started a little over a year ago trying to put in a spend classification and analytics system, and basically it's taken us that long to get the kinks out of it."
It wasn't supposed to take a year. Many software vendors will tell you it shouldn't take nearly that long, either. Hartman says he and his team ran into a major snag that added an additional seven months to the software's roll-out—something that he calls dirty data.
"The main issue that we're seeing that I think companies will face is what the industry calls ETL: extract, transform and load," he says. "The vendors want to show you the analytics and the dashboarding and all that stuff because everybody really likes shiny things, and that's what they are. What they don't show you is the greasy stuff that makes the shiny stuff work, and that's the ETL."
The extract, transform and load function is often handled by a service provider such as a data warehouser, which basically "cleans up" the data so spend-analysis programs can process it and give back useful information. Without proper data, a spend-analysis program is useless.
"It's going to take you a long time to collect your spend data in a way that your classification and analytics software folks can make sense of it," says Hartman.
Four months after procuring a spend-analysis program, Boston Scientific gave the program its first run. Hartman and his team weren't happy with the results. The data Hartman's team tried to funnel through their spend-analysis program was basically too "dirty" to get much out of it.
He lists a few of the dilemmas Boston Scientific faced in cleaning up their data: multiple names for the same vendor, redundant material numbers, fragmented Pcard and T&E card information, PO and AP spend information, divisions not in the company's central ERP system, and multicurrency problems. All these different problems made for a particularly tricky ETL challenge to Hartman and his team before they could get any quality information out of their spend-analysis program.
"You put all of that into a pot and stir it around and at the end of the day, your software provider needs a file that they can understand," he says. "It's not simply an IT exercise, because you have to understand where you want to go, what you want to see and how you want to see it. That will dictate the data that you need to extract and how you will need to normalize it."
What to expectAt its simplest, making sure you're ready for a spend-analysis program is a question of doing your homework before you dive in.
"You need to know the answer before you start asking the questions on the data. You have to do it backwards," Hartman says. One example he cites is measuring compliance. How do you quantify compliance? What materials and services will you count? What do you do if you're buying from a vendor both compliant and non-compliant items or services? If this information isn't stored on your ERP system, how do you begin to measure that at all?
Hartman adds that many of his suppliers assured him they had ETL tools that would help Boston Scientific clean up and compile its data, but the company still had difficulties. Thankfully, Hartman says, Boston Scientific's spend-analysis software vendor stepped up and helped the company with its data difficulties. "The vendor was pretty up front, and gave us the file structures, then sat down with us to go through them—they were very good about it," he says. "We went into this thing with our eyes wide open and despite that, we still didn't think through all of the complexities that we needed to." Every buyer needs to be cognizant of these hidden time costs.
Although it snagged Boston Scientific's spend-analysis roll-out, highly detailed and organized data is exactly what appeals to many buyers, including Pat Walker, vice president of finance and top procurement executive at Walker Machinery, in Belle, W.V. His company's raw spend information was about as low-tech as it could get: paper purchase orders.
"We knew how much money we were spending and who we were spending it with, but not what exactly we were buying," he says. "All that information was locked into the paper orders. We needed information like quantity, price and SKU." This dearth of detailed information made it difficult to compare suppliers to see if Walker Machinery was getting the best possible deal. "If we knew exactly what we were buying, then we could take that activity and all that detail, give it to suppliers and ask what it'd cost to do business with them."
Hartman: “You need to know the answer before you start asking questions on the data.” |
"Definitely be more conservative than software vendors," he says. "When you start talking about software productivity dollars, it can be a tough sell. If I was on the other side of the table, I'd be very skeptical and question everything."
How to make the caseFor his business case, Walker made a comparison between the paper-based system and the potential with spend-analysis software. "We came from a traditional paper-based PO system, about as freeform as you could get," he says. When his company made a homegrown electronic PO system, it wasn't much better—just a digital version of the paper method.
"Six Sigma really highlighted how handicapped we were in capturing supplier spend," he says. After the company's switch to spend-analysis software, Walker Machinery now has a much easier time identifying high-volume suppliers, a powerful negotiation tool. "It wasn't plug-and-play," says Walker, but was a welcome improvement.
One tip in building a good business case is to determine your needs by looking at where your current capabilities are lacking, says NPI consultant Jeff Muscarella. "Look at the existing modules in your ERP system and the organizational standards in your company—where's the gap? Build your business case and determine the return on closing that gap." One possibility says Muscarella, especially at smaller companies, is to be resourceful and "fill in the gaps with your own solutions," though he cautions this isn't always successful.
When it's not, there are plenty of commercial options to choose from, as you'll see on page 45. The key to deciding which works for you: a detailed understanding of your own business process—and a keen eye for those hidden costs.
| Company nameand URL | Application name | Description and latest improvements to software | Delivery model (license, on-demand, both) | Pricing model |
| Ariba, Inc. www.ariba.com | Ariba Spend Management | Ariba has added more than 140 new capabilities across its solutions. The latest release of multi-tenant offerings enables companies to accelerate results by driving greater visibility, active compliance, and rapid adoption. | Both | Annual subscription for licensed, subscription licenses for on-demand |
| Avotus Corporation www.avotus.com | Avotus Intelligent Communications Management | Automated online procurement, invoice processing, inventory management, comprehensive usage management enable Avotus customers to realize significant reduction of their voice, mobile and wireless, data and converged communications spend. | Both | Annual subscription or perpetual license with maintenance |
| BasWare, Inc. www.basware.com/us/ | BasWare Invoice Processing, Purchase Management, KPI Tool | Enhancements to BasWare's Enterprise Purchase to Pay portfolio include Invoice Processing and Purchase Management. BasWare's new Key Performance Indicator (KPI) software and consultancy tool helps organizations analyze spend and drive savings through continuous improvement in purchasing and accounts payable. | Both | Subscription or licensing |
| Emptoris www.emptoris.com | Emptoris Spend Analysis | Emptoris offers a spend analysis solution that augments a company's ERP, data-warehouse and business intelligence systems and provides deep spend visibility. The Emptoris solution includes a spend analyzer, spend data manager, and real-time spend classifier, as well as new spend and contract visibility offerings. | Both | Subscription or licensing |
| ePlus, Inc. www.eplus.com | Spend+ | Improvements to the graphical user interface, navigation. Performance increases and additional taxonomies. | Both | Subscription or licensing |
| Iasta www.iasta.com | SmartAnalytics | SmartAnalytics provides a centralized analysis tool for viewing and evaluating purchasing data so purchasing teams can analyze spend, control how often to refresh spend data, generate new reports and update existing reports without IT support. | Both | Monthly, quarterly, annual subscriptions available |
| Ketera Technologies, Inc. www.ketera.com | Ketera Spend Analysis | The latest version of the Ketera Spend Analysis solution cleanses, normalizes, and classifies spend data using automated and patent-pending Ketera Spend Processing technology to ensure actionable and intelligent spend analytics reports. | On-demand | Monthly subscription |
| Oracle www.oracle.com | Oracle Daily Business Intelligence for Procurement | Oracle Daily Business Intelligence for Procurement is a web-based analysis and reporting tool designed to identify savings opportunities and track supplier performance. Web-based reports enable managers to view spending details, analyze data, measure performance, and develop strategies for increased savings. | Both | Perpetual license |
| Procuri, Inc. www.procuri.com | TotalSpend | Recent enhancements include simplified ETL and data extraction adapters for all ERP systems, role-based spend dashboards and online data drilling, and advanced category, diversity, and knowledge management features. | On-demand | Annual license |
| PurchasingNet, Inc. www.purchasingnet.com | PNet | Version 8.0 includes feature and function improvements such as extended platform support, usability enhancements (including new interface), SOX and security enhancements, process control improvements, and non-PO invoicing improvements. | Both | Perpetual, subscription, and on-demand models |
| Quadrem www.quadrem.com |
Quadrem Spend Intelligence | QSI is a desktop solution that unearths valuable spend data in a fraction of the time, and at much lower cost, than traditional data warehousing methods require. Procurement teams can build multi-million item spend datasets with robust functionality. |
On-demand | Varies depending on deployment |
| SAP www.sap.com | SAP Spend Analytics | SAP's spend analytics solution is now integrated with operational procurement and enterprise resource planning (ERP), providing organizations with better access to spend and sourcing operational data which can be leveraged to provide new insights and help identify relationships in the data that were previously unavailable. | Both | Annual license |
| SAS Institute www.sas.com | SAS Solutions for Supplier Intelligence/SAS Spend Analysis | SAS Spend Analysis software uses weighted averages and operations research technologies to add balance and flexibility to the supplier evaluation process. The solution gathers, cleanses, transforms and analyzes data to optimize strategic sourcing. | Both | Annual license |
| SciQuest www.sciquest.com | SelectSite/Higher Markets | Improvements to the application's User Interface. Added configuration options which allow SciQuest On-demand solution to meet unique customer requirements. Improvements to the Materials Management application allowing customer inventory to integrate seamlessly into the e-Procurement environment. | On-demand | Annual subscription |
| TSA Inc. (dba Puridiom) www.puridiom.com |
Puridiom | Comprehensive procure-to-pay spend management solution continually adding features to improve overall performance and compliance. Recent improvements include enhanced access integration with LDAP, extended contract management capabilities, advanced best value sourcing features, and new reporting interface with additional analytic reports. | Both | Annual License or subscription for on-demand |
| Verian Technologies, www.verian.com | ProcureIt | ProcureIt captures transaction-level spending data in a single database for retrieval and analysis. The improved reporting wizard allows users to create custom spending and vendor performance reports on-demand. | Both | Subscription or licensing |
| Zycus, Inc. www.zycus.com | Zycus SDM Suite and Analytix | SDM Suite: Automatic identification and classification of multi-lingual data to one or more taxonomies using artificial intelligence, a global system with high accuracy levels for direct and Indirect spend. Analytix: Goes beyond spend visibility taking data savings to the next level of ROI through pipeline-driven management of savings opportunities. | Both | Annual license, perpetual license, subscription |
















Hartman: “You need to know the answer before you start asking questions on the data.”
View All Blogs

