Streamforge

Evaluating creator data

How to Evaluate Creator Data From Any Vendor

Every influencer platform says its data is accurate. This is a practical way to check: five questions to ask about coverage, audience figures, freshness, sponsorship counts and media value, and a test you can run on creators you already know.

Nick LombardiCo-Founder & CTO, StreamforgeLast reviewed

Five questions
One for each kind of creator data
One test
Run on creators you already know
Any vendor
Streamforge included

The short version

Compare answers on creators you already know, not feature lists

A creator profile mixes numbers that were counted, numbers that were estimated and numbers that were modelled. All three are useful once you know which is which. Ask a vendor how each number is produced, then check its results against creators whose real figures you have seen.

Three kinds of number on a creator profile

Counted

Followers, subscribers, views, likes and comments come from the platform itself. What matters is when they were collected.

Estimated

Audience demographics for a creator who has not connected an account come from a model. What matters is what the model learned from and whether it was checked against real audience data.

Modelled

Media value and sponsorship classification apply a method to the data. What matters is whether the method is written down.

A test you can run in an afternoon

  1. 01

    Pick creators you know

    Choose five to ten creators you have worked with, ideally ones who shared their own analytics or whose campaign results you hold. Include smaller creators as well as large ones.

  2. 02

    Find them twice

    Look each one up by name. Then try to reach the same creator by describing them: platform, topic, country, audience. A creator you can only find by name is one the tool would not have surfaced for you.

  3. 03

    Compare the audience

    Put the vendor's audience figures beside what you know. Check countries, age and gender first, then whether the interests sound like the community you saw.

  4. 04

    Read the dates and the labels

    See when the fields you rely on were last updated, and whether estimated figures are presented as estimates.

Coverage: can it find the creators you need?

A platform is only useful if the creators you need are in it and you can get to them. Ask two things. First, where the creators come from: a database the vendor builds itself, or a marketplace that lists creators who signed up. A marketplace can be a good place to hire, but it cannot show you someone who never joined. Second, how search works: whether you can filter on the audience and the content, or only on the creator's own follower count and category.

Then test it with the creators that are hard to find. Well-known names tend to turn up anywhere. Search for the smaller creators in your niche, the ones you already know exist, and see whether the tool gets you to them without typing their name.

Streamforge's answer: we built our own creator database and used it to run campaigns before opening the platform to customers. It is not a list of creators who opted in.

Audience: where do the figures come from?

Audience demographics have two possible sources. One is the creator's own analytics, shared by connecting an account. The other is a model that works from what the audience does in public. Connected-account figures are exact, but they exist only for creators who agreed to connect, which usually means creators you are already talking to. A model can cover a creator you have never contacted, and its quality depends on how it was built.

So ask what the model was trained on, and whether its output has been compared with first-party platform data. A vendor that has done that comparison will be able to tell you what it showed.

Streamforge's answer: Streamforge's audience analysis is AI-based and does not require the creator to authenticate through OAuth. The model was trained on first-party audience data, and in Streamforge's tests its results are extremely close to the platforms' direct metrics.

Freshness: how old is each number?

One refresh promise cannot describe every field on a profile. A follower count, last week's videos and a modelled audience change at different speeds and are collected on different schedules. Ask to see the update time on the fields you will rely on, for the size of creator you book.

Freshness matters most for numbers that move quickly, such as recent views, and for creators who are growing fast. It matters less for things that shift slowly, such as which countries an audience is in.

Streamforge's answer: each field is refreshed on its own schedule. Freshness depends on the source, platform, creator, and field.

Sponsorships: what counts as one?

Competitive research depends on counting sponsored content, and tools count it differently. Counting only disclosed posts misses deals that were never labelled. Counting every brand mention sweeps in affiliate links, a creator promoting their own business and mentions nobody paid for, which makes a competitor's spend look larger than it is.

Ask whether a sponsorship figure separates those cases, and what evidence puts a piece of content in each one.

Streamforge's answer: sponsorship, affiliate activity, first-party promotion and organic mentions are four separate classifications, and no single hashtag is required to detect one.

Media value: how is it calculated?

An estimated media value is a reach figure multiplied by a rate. It is useful for comparing creators and planning a budget as long as you know which reach figure and which rate went in. Ask how the value is calculated for each format, and keep it apart from attributed revenue when you report results.

Streamforge's answer: on-demand content and live streams are valued with different models, and audience geography, industry and format are applied to each estimate.

What good answers have in common

A vendor with strong data can tell you how each number is made, can show you when it was last updated, and is willing to be tested on creators you choose. Those three things say more than the length of a feature list.

If a platform keeps missing creators you know exist, or cannot tell you who their audiences are, the problem is the data underneath, and no amount of workflow on top will fix it. That is the part worth testing before you sign.

Common questions

How many creators do I need for a fair test?

Five to ten that you know well is enough to see a pattern. Include a couple of smaller creators and at least one on each platform you plan to use.

What if two vendors disagree about the same creator?

Check both against the creator's own analytics if you can get them. If you cannot, favour the vendor that can explain how its figure was produced and what it was tested against.

Are estimated audience figures good enough to plan a campaign on?

Yes, when the model behind them has been checked against real audience data. Estimates are what let you compare hundreds of creators before speaking to any of them. For your finalists, ask for their own analytics as a last check.

Does Streamforge hold its own data to this?

Yes. Each kind of data has its own method page on this site, and the audience method has been benchmarked against first-party audience data from the platforms. Bring your own creators to a call and test it.

Give every vendor the same test

A comparison is only fair when each platform sees the same creators and the same questions. Run the test the same way each time, and judge on the fields your campaigns depend on.

Run the test on Streamforge

Bring the creators you know and the audience you need to reach. We will go through the results with you, creator by creator.

Book a Demo