Tracking

The challenge of measuring across different ecosystems

A modern newsroom rarely operates in a single environment. It publishes on websites, apps, newsletters, video platforms, and social media. Each environment generates different signals, with different definitions and different levels of control over the data.

Moving toward a more mature data culture does not mean simply putting all numbers into a single dashboard without criteria, but rather understanding what can reasonably be compared and what cannot.

Web, app, video, and social: similarities and differences

Web, app, video, and social: similarities and differences

Not all platforms define a view, play, interaction, or session in the same way. The same word can mean different things depending on the tool.

For this reason, the goal should not be to artificially equalize all metrics, but to build a common layer of interpretation. For example:

• reach or exposure
• initial interaction
• consumption or attention
• return
• conversion or valuable action

The key is to ask a common question and then find the best available approximation in each channel. Rather than comparing a newsletter click with a social media impression directly, a team might instead ask: “How many users did each channel bring to our website this month?” That question can be answered consistently across most channels — even if the underlying signals differ. The goal is not to find a single number that captures everything, but to build a shared frame that makes cross-channel conversations possible.

Which metrics are comparable and which are not

It is useful to distinguish between:

• directly comparable metrics
• partially comparable metrics
• metrics that only make sense within each platform

For example, it may be reasonable to compare traffic contribution, new users, or the ability to bring audiences to owned platforms. However, it does not always make sense to compare a social media view with a web session as if they were equivalent.

The practical consequence of mixing incomparable metrics is that teams draw false conclusions. A channel that generates a large number of low-cost impressions can appear to “outperform” one that delivers a smaller number of highly engaged sessions — simply because the numbers are placed side by side without context. Before combining metrics from different platforms into a single view, it is worth asking: are these numbers measuring the same underlying behaviour, or just using the same word to describe something different?

North Star metric and stage-based metric system

A North Star metric is a primary metric that summarizes the central value an organization wants to drive. It does not replace other metrics, but it helps align interpretation and decision-making.

Alongside this main metric, it is useful to define secondary metrics by stage:

• acquisition
• activation
• engagement
• conversion
• retention

This structure prevents dashboards from becoming collections of disconnected numbers and helps teams interpret performance with greater focus.

Coherent measurement and minimal data governance

As channels and teams expand, the need for a certain level of governance also increases:

• shared naming conventions
• common definitions
• validation criteria
• basic documentation

This is not about bureaucracy. It is about avoiding situations in which comparisons between teams, products, or time periods become fragile or misleading.

Try it yourself

Your head of digital has assembled the following combined dashboard to track “total reach” across all channels last month:

At the all-hands meeting, she announces: “We reached over 2.8 million people across platforms this month.”

Consider:

1. What’s wrong with adding these figures together? Which metrics are genuinely comparable — and which aren’t?
2. If your goal is to measure how many people consumed your content with meaningful attention, which metrics would you keep, and which would you set aside?
3. Newsletter opens (94,000) and Instagram impressions (920,000) are both shown as “reach.” Can you treat them as equivalent? What’s the conceptual difference?
4. If you had to propose a single North Star metric that works across all channels — oriented around growing loyal readers — what would it be, and why?

Measuring more channels doesn’t automatically mean having a clearer picture. It means you need more structure.