Use Cases 4 min read

Proxies for Market Research: Seeing Each Market as a Local Customer Does

Competitor pricing, localized offers and product availability all change by country. Here is a repeatable way to collect it.

Market researchers, strategy teams and consultants use proxies for market research to answer questions like: what does a competitor charge in France compared with the UK, which products are available in Australia, and how does a brand position itself to German customers? Websites localize by visitor country, so you can only answer those from the market itself. A proxy puts your browser or script in that market.

Start with the Question, Not the Scraper

Most research projects collect too much and answer too little. Before choosing proxies, write down:

  1. The question - for example, 'Do our three main competitors price lower in Germany than in the UK?'
  2. The markets - the country codes you need.
  3. The pages - specific product, pricing or landing pages, not whole sites.
  4. The frequency - once, weekly, or daily for a month.
  5. The evidence - screenshot, HTML, extracted fields, or all three.

That list tells you how many page loads you need, which tells you bandwidth, which tells you cost. It also keeps the project proportional - a few hundred page loads, not a crawl.

Make Each Visit Look Like a Local Customer

Sites decide what to show using the IP, the Accept-Language header and sometimes the timezone. If they disagree, you may see the international fallback version, which is not what local customers see. Set all of them per market:

MARKETS = {
    'gb': {'lang': 'en-GB,en;q=0.9', 'tz': 'Europe/London'},
    'de': {'lang': 'de-DE,de;q=0.9', 'tz': 'Europe/Berlin'},
    'fr': {'lang': 'fr-FR,fr;q=0.9', 'tz': 'Europe/Paris'},
    'au': {'lang': 'en-AU,en;q=0.9', 'tz': 'Australia/Sydney'},
}

def proxy_for(cc, run_id):
    return f'http://USERNAME-country-{cc}-session-{run_id}{cc}-time-15:[email protected]:8080'

Capture Evidence You Can Defend

Research findings get questioned. 'Competitor X is 12% cheaper in Germany' needs evidence: a screenshot, the page HTML, the date, the market, and the IP the page was loaded from. This Playwright script captures all of it for each market:

import json, datetime, pathlib
from playwright.sync_api import sync_playwright

URL = 'https://competitor.example.com/pricing'
RUN = datetime.datetime.utcnow().strftime('%Y%m%d%H%M')
out = pathlib.Path('evidence') / RUN
out.mkdir(parents=True, exist_ok=True)

with sync_playwright() as p:
    browser = p.chromium.launch()
    for cc, m in MARKETS.items():
        ctx = browser.new_context(
            proxy={'server': 'http://global.nodeproxies.xyz:8080',
                   'username': f'USERNAME-country-{cc}-session-r{RUN}{cc}-time-15',
                   'password': 'PASSWORD'},
            locale=m['lang'].split(',')[0], timezone_id=m['tz'])
        page = ctx.new_page()
        ip = page.goto('https://api.ipify.org?format=json').json()['ip']
        page.goto(URL, wait_until='networkidle')
        page.screenshot(path=str(out / f'{cc}.png'), full_page=True)
        (out / f'{cc}.html').write_text(page.content(), encoding='utf-8')
        (out / f'{cc}.json').write_text(json.dumps({'market': cc, 'ip': ip, 'url': URL,
                                                    'utc': RUN}))
        ctx.close()
    browser.close()

The sticky session means the IP check and the page load use the same IP, so the IP you record is the one the site actually saw. Run the MARKETS block from earlier in the same file. If you prefer checking by hand, what is my IP shows the exit IP and location in a browser.

Common Market Research Jobs

  • Localized pricing and currency on competitor product and pricing pages.
  • Product range and availability by country.
  • Messaging and positioning: headlines, offers and imagery per market.
  • Search visibility per country - see proxies for Google SERP scraping.
  • Ad presence per market - see proxies for ad verification.

For recurring price comparisons, the tracking approach in proxies for price monitoring scales better than repeated screenshots.

Turning Captures into Findings

Screenshots are evidence; a table is a finding. After each run, extract the few fields your question needs - price, currency, plan name, availability - into a spreadsheet with one row per market and page, plus the run ID that links back to the evidence folder. Convert currencies at a fixed reference rate for the run date and note which rate you used. When a result surprises you, re-run that single market with a fresh session before reporting it, to rule out a one-off A/B test or personalised offer.

Choosing Proxies and Sizing the Budget

Residential proxies show you the consumer version of a site and cover 195+ countries, which matters when a project spans many markets. Full-page screenshots with images use more data than text-only fetches; run your script once, read the usage, and multiply. At $0.65/GB for small plans, a one-off study of a few hundred pages typically fits in a small plan. Keep collection within each site's terms and robots.txt, and avoid personal data - see are proxies legal.

Doing It with NodeProxies

Register, top up from $3 by card or crypto, and buy a residential plan in MB or GB. Use the country code per market and a session ID per run. There is no subscription and no ID verification, and balance never expires between projects. See pricing.

FAQ

How do I see a website as it appears in another country?

Load it through a residential proxy in that country with the browser language and timezone set to match.

Why do I see the international version of a site through a proxy?

Usually the Accept-Language or timezone does not match the IP country, or the site uses a stored cookie. Use a fresh browser context per market.

How much proxy bandwidth does market research need?

Measure one run and multiply by the number of markets, pages and repeats. Text-only fetches use far less than full-page screenshots.

NodeProxies

Ready to get started?

90M+ residential, mobile & datacenter proxies. Datacenter from $0.30/GB, residential from $0.42/GB. No contracts.

Create free account