Lora's Latest Post

Is this the Future of Downstream Data?

It started as simple sales reporting. It is no longer simple.  In 2005, there were five consumer product leaders actively using downstream data (retail inventory and sales data).  Today, over 80% of consumer products companies greater than 1 billion in revenue are redefining work processes to use it.  The space is murky. It is not easy, and it is evolving. However, the deeper teams explore the usage of the data, the more excited they get.  This has been FUN to watch.
One of the things that you get to do as an analyst is name things.  We get to put OUR stamp –usually a cool three-letter acronym—on new technologies, processes and trends.  (At least, we think that it is cool.)  I am one of the mother’s of the Demand Signal Repository (DSR) term. It was originally defined by Kara Romanow, now Executive Editor at Consumer Goods Technology (CGT). I was an early collaborator with Kara.  It took shape and form from my fingertips as I wrote about the usage of downstream data in consumer value networks.  I have followed the market for the past six years.  Kara and I like to joke, that we were both mothers in the genesis and market acceptance of the term DSR.
A DSR is a repository of demand information. Demand information comes in many different forms—orders, shipments, syndicated data, point of sale information, warehouse withdrawal information from retailers, customer panel groups—and needs to be used by many different roles within the organization—sales for account reporting, marketing for promotional/new item acceptance and market share analysis, supply chain for forecasting and out-of-stock sensing, and R&D for new product launch insights.  The problem is that everyone wants it in a different form—frequency, granularity, attributes—and the data processes of cleaning, harmonizing and synchronizing are messy requiring a strong understanding of the data.

Help me Get it Right

So, as one of the mother’s—some would even disdainfully say “muther“—of the term DSR, I have been thinking about the evolution of this market and the market drivers, and I wanted to get some community input.  I am writing a report on market evolution and wanted to get community input on the evolution of the technologies.  (One of the exciting aspects of Altimeter Group’s research model is open research with the community.)  So, I welcome your feedback, do you think that these are the right trends?

Right Trends?

2010 will be the year of predictive analytics.  The DSR is not the end state.  The value of downstream data is the USAGE of the data into new business processes/work streams.  Whether it is Vision Chain’s new sensing of out-of-stocks, or Terra Technology’swork on short life cycle product sensing.  2010 is the year of predictive analytics.  Look for new applications to evolve.  I predict exciting launches in the area of price and promotion compliance, market basket analysis, shopping patterns, damage, and category analytics.  I find the convergence of loyalty data, point of sale information and geo mapping technologies very exciting to give live representations of market out-of-stocks, customer demand, and near real-time sensing of market trends.
In parallel, we will see market convergence of the technologies.  There are just too many sales reporting applications in the market, and predictive analytics vendors will need a database structure to enable insights from harmonized, disparate data sources (E.g. Nielsen’s TDLinkx product, orders, shipments, syndicated data, point of sale, warehouse inventory levels, retail inventory levels, etc).
It won’t just be about modern trade.  Hopefully, by now, it is clear to everyone that there has been a step change in data sharing by retailers in North America and Europe.  No, not everyone is sharing data; but, the data that is being shared gets more significant, and better quality, each year.  Customers that are working at getting the data now have  70% of North American and 30% of the European grocery markets.  (The secret is knowing how to ask for it.)
As companies use downstream data for modern trade, they will use the techniques to build demand networks to tackle the challenge of emerging markets.  The bullwhip effect of distributor relationships is just too painful. Consider the differences in table 1 for the food industry.
Table 1:  Bullwhip effect

Supply Chain Type Demand Latency from Shelf to Order Order Cycle Time Manufacturing Cycle
Modern trade for warehouse distribution 10-14 days 3 days 10-20 days
Emerging markets 40-48 days 1 day 30-40 days
Food service 24-35 days 2-3 days 30-40 days

 
Leaders will build distributor networks (similar to Anheuser’s Budnet) as part of the infrastructure to capture market share in the evolving markets.
Differentiation will come from enrichment and the design of the information layer.  To serve multiple roles and to enable new discovery, the secret sauce is the design of the information layer.  It is not a traditional Master Data Management (MDM) problem. Instead, it requires flexible data assembly and quick data parsing.  I believe that we will see the use of Search Engine Optimization (SEO) technologies like Endeca evolve to help companies solve this problem. (I saw some interesting evolutions of this concept in India past week.)   In parallel, new content—store demographics, in-store shopping data, panel data—will evolve.  These two elements will enable the true POWER from the new predictive analytics.
SAAS, License, Cloud.Initial forays into the usage of downstream data will be deployment neutral:  a true toss-up between license and Software as Service (SaaS) models.  However, as data enrichment and advanced predictive analytics evolve, the DSR will come behind the firewall. Similarly, as social media turns into social commerce, an information layer will evolve in the cloud for the value chain.  This value chain information layer will enhance not replace the enterprise DSR.

Figure 1: Downstream Data Evolution

Social Commerce will Power the Tipping Point.  As power shifts from the retailer to the shopper, social media technologies will power social commerce business processes (the ability to buy, return, shop on mobile devices based on reviews, price and inventory levels). Channels will blur as we enter the hype cycle of social commerce.  To power these applications Point of Presence (where is the shopper) will combine with Point of Sale (POS) to track the success of social CRM. The amplitude of the hype cycle will be immense—a mini dot.com era—but, it will be the tipping point for the usage of downstream data and the design of outside-in value network.

 Evolution. Do I have it Right?

So, what do you think? Do I have it right? Will it look like figure 1?  Let me know your thoughts.  Your input will serve as foundational input to refine the models for the report that I am writing on downstream data technologies in August.
Until then….  The Supply Chain Shaman is happy to be back from a very fruitful trip to India, and will be busy with research and advisory calls this week on the east coast of the United States.

Search the Archives
Search
Share this Post
Email
Twitter
LinkedIn
Facebook
Pinterest
WhatsApp
Featured Image
Recent Posts

My Answer to Joe. The Future of APS

Traditional Advanced Planning Systems (APS) are unlikely to become true enterprise platforms because organizations remain functionally siloed, metrics are misaligned, and current APS architectures were designed for an environment that has fundamentally changed. Here I share how I think that APS systems can adapt to drive more value.

Read More »

Teaching Your Organization to Jump

Remember the story of the frog in the pot of water? If the water temperature rises slowly, the frog doesn’t recognize the danger until it is too late. Put the frog directly into boiling water, and it jumps.

I think the analogy applies to today’s supply chains.

Companies are absorbing increasing volatility and complexity without fundamentally redefining how work gets done. Companies have confused historic practices with best practices. They are now taking those same processes and attempting to automate them with agents and agentic AI—without first stopping to ask a more fundamental question: Is it time to jump? Here I give a five-step action plan.

Read More »

Navigating Supply Chain Economic Downturns

In 2007, the average company took six months to sense market shifts and adapt its supply chain. My estimate, based on work with clients, is that if a downturn happened today, the average company would take 20-30% more time to adjust than in 2007. Here I give insights on preparedness.

Read More »

Warning: Sidestep the Narrative of the Misguided Goldiggers

Ten years ago, I started writing a book titled Stories of the Misguided Gold Diggers. The book was a collection of stories from two decades of stories of technology leaders perpetuating the myth of integrated end-to-end supply chain planning.

I dusted off the manuscript on Saturday. I think that we have a new chapter. Companies focused on putting Artificial Intelligence (AI) on top of existing architectures are putting AI Stupid on steroids.

Read More »

The Myth of End-to-End Planning

Supply chain planning, supply management, supply chain execution, network design, and transportation/logistics management operate in silos. Not much has changed over four decades. The connections flow back through transactional systems: order-to-cash and procure-to-pay. There is a myth that companies can buy an end-to-end supply chain management solution. This is largely a myth. Here we explain.

Read More »

Lead Time: A Broken Gossamer

If you are struggling with supply chain planning, dancing in the light of shiny objects, and scratching your head, please read on. My goal is to help you.

Please do not AI Stupid. What do I mean? AI Stupid is putting agents and agentics on top of existing architectures believing that making them faster and hands free add value. To me, this is fools play.

I love AI. I am excited about new technologies. To this end, I want to shine a light on how new technologies can help address the black holes and inconsistencies in today’s supply chain, which largely stem from the limitations of the first generation of supply chain planning and execution technologies. In this blog, I give you three places to start.

Read More »