Ecommerce founders use proxies for Shopify store research to keep an eye on competitors: new products, price changes, discounts and stock. The good news is that Shopify storefronts are unusually easy to read politely, because most of them publish a public product feed in JSON. Proxies come in when you watch many stores, or when you need to see the localized prices a store shows to visitors from different countries.
The Public products.json Feed
Most Shopify storefronts answer at /products.json with their published products, including titles, variants, prices, SKUs, availability and timestamps. It supports a limit parameter (up to 250) and a page parameter. Some stores disable or restrict it, so treat it as a convenience, not a guarantee. Here is a paginated reader:
import time, requests
PROXY = 'http://USERNAME-country-us:[email protected]:8080'
def fetch_catalog(store):
products, page = [], 1
while True:
r = requests.get(f'https://{store}/products.json',
params={'limit': 250, 'page': page},
proxies={'http': PROXY, 'https': PROXY},
headers={'User-Agent': 'Mozilla/5.0'}, timeout=30)
if r.status_code != 200:
print(store, 'returned', r.status_code)
break
batch = r.json().get('products', [])
if not batch:
break
products.extend(batch)
page += 1
time.sleep(2)
return products
for p in fetch_catalog('competitor-store.com')[:5]:
v = p['variants'][0]
print(p['title'], '|', v['price'], '|', 'in stock' if v.get('available') else 'sold out')A catalog of a few hundred products is only a handful of small JSON requests - far lighter than rendering product pages in a browser. One request per page every couple of seconds is gentle on the store.
Tracking Changes Over Time
A single snapshot tells you little. The value is in the diff: what was added, removed, repriced or sold out since yesterday. Store each run keyed by variant ID and compare:
import json, pathlib, datetime
def snapshot(products):
return {str(v['id']): {'title': p['title'], 'price': v['price'],
'available': v.get('available')}
for p in products for v in p['variants']}
def diff(old, new):
for vid, cur in new.items():
prev = old.get(vid)
if prev is None:
print('NEW ', cur['title'], cur['price'])
elif prev['price'] != cur['price']:
print('PRICE ', cur['title'], prev['price'], '->', cur['price'])
elif prev['available'] != cur['available']:
print('STOCK ', cur['title'], 'available' if cur['available'] else 'sold out')
for vid in old.keys() - new.keys():
print('REMOVED ', old[vid]['title'])
path = pathlib.Path('competitor.json')
new = snapshot(fetch_catalog('competitor-store.com'))
if path.exists():
diff(json.loads(path.read_text()), new)
path.write_text(json.dumps(new))
print('saved', datetime.date.today())Run it once a day on a schedule and you have a competitor change log. For broader price-tracking architecture across many sites, see proxies for price monitoring.
Seeing Localized Prices by Country
Shopify stores that sell internationally often show different currencies and sometimes different prices depending on the visitor's country, detected from the IP. To see what a UK shopper pays, request the store through a UK IP. Change the country code in the username and repeat:
for cc in ['us', 'gb', 'de', 'ca', 'au']:
proxy = f'http://USERNAME-country-{cc}:[email protected]:8080'
r = requests.get('https://competitor-store.com/products/some-product.json',
proxies={'http': proxy, 'https': proxy}, timeout=30)
v = r.json()['product']['variants'][0]
print(cc, v['price'])Whether the JSON reflects local pricing varies by store setup; if the numbers are identical across countries, load the product page itself in a browser through each country and read the displayed price. Compare the result with how you price your own store in those markets.
Why Use Proxies at All?
- Watching dozens of stores from your own IP can trigger rate limits on the shared platform infrastructure, which then affects your normal browsing.
- Country-specific pricing and currency only show up from an IP in that country.
- Keeping research traffic separate from the IP you use to run your own store admin is simple hygiene.
Respect each store's robots.txt and terms and keep request rates low; our article on how to avoid blocks when web scraping explains why slow and steady beats aggressive rotation.
Choosing a Proxy Type
Because product JSON is small and storefronts are not usually heavily protected, datacenter proxies from $0.42/GB are a sensible default for catalog tracking. Switch to residential proxies for stores behind stricter bot protection or when you need localized pricing from home IPs. Our comparison of datacenter vs residential proxies explains the trade-off.
Doing It with NodeProxies
Create an account, deposit from $3 by card or crypto, and start with a small datacenter or residential plan - JSON tracking for a handful of stores fits comfortably in a few hundred MB per month. Use -country-xx for localized checks. No subscription, no KYC, and your balance never expires. See pricing for volume tiers.
FAQ
How do I see all products in a Shopify store?
Try /products.json on the store domain with limit=250 and increasing page numbers. If the store disables it, use the collections pages or sitemap instead.
Can I see what price a Shopify store shows in another country?
Yes. Load the store through a proxy in that country; stores using international pricing detect the visitor's country from the IP.
Do I need residential proxies for Shopify research?
Often not. Datacenter proxies handle product JSON well. Use residential when a store blocks server IPs or for localized pricing checks.
