QA Test Report

Auto Marketing Engine · full validation against the WholeTech owned-domain network · July 04, 2026 15:09 UTC

Week-0 baseline dataset → the field-test starting line

A frozen, timestamped stratified sample (n=54, 27 treatment / 27 control across both networks) capturing every site's baseline scores + real AWStats traffic, for the Automated Marketing Dept experiment. View the baseline dataset → · raw baseline.json

245Owned domains tested

245Analyze pass (valid result)

0HTTP 500 / hard fails

245Report 200 (post-fix)

5/5Full-flow pass

0Network-run errors

84Avg readiness (238 sites)

13Limited fetch (auth-walled)

Result summary

Part 1 — Analyze: all 245 owned live domains POSTed to /api/analyze returned a valid, site-specific result (real title, detected niche, five 0-100 sub-scores + overall). Zero HTTP 500s, zero hard failures.
Part 2 — Report: /report/<domain> initially 200 for 238 and 404 for 7 redirect aliases; after the alias fix all 245 return 200 with real branded content.
Part 3 — Full flow (5 diverse sites): hulloships.com, austincoffeeshowdown.com, thaivillaexchange.com, robotnewstoday.com, texascoworking.com. Each activated, generated real content/SEO/social deliverables, approved one, reloaded from disk, confirmed persisted. 5/5 pass.
Part 4 — Whole-network run: /api/network/run over the 245-domain owned list finished 245/245 with 0 errors in ~120s (5-way concurrency).

Readiness distribution (238 unique scored sites)

210Strong 75-100

12Needs work 55-74

16Rough 0-54

84Network average

Bugs found & fixed (in `/opt/autoengine/server.py`)

FixedDomain corruption from str.lstrip("www.")

lstrip("www.") strips any leading w/. characters, not the literal www. prefix. So wholetech.com was stored/looked-up as holetech.com, walhus.com as alhus.com, etc. — corrupting workspace keys, report lookups and portfolio identity for every domain beginning with w. Present at 12 call sites.

Fix: Added a correct prefix-strip helper _lw() (s[4:] if s.startswith("www.") else s) and replaced all 12 uses. Removed the two corrupted workspace files.

FixedRedirect-alias reports returned 404

7 owned hostnames 301-redirect to a canonical site (claude/codex/gemini/grok/os.wholetech.com → ai.wholetech.com; thaivillas.wholetech.com & thaivillas.wholevoyage.com → thaivillaexchange.com). The engine correctly followed the redirect and stored the workspace under the canonical, so /report/<alias> 404'd.

Fix: On analyze, when the requested host differs from the resolved (post-redirect) host, a tiny alias_of stub is written; load_ws() resolves it one hop. All 7 alias reports now return 200.

FixedAlias stubs polluted the portfolio as 0-score rows

The new alias stubs (no analysis payload) surfaced in the portfolio as overall=0 entries, dragging the network average down.

Fix: portfolio_rows() and list_ws() now skip alias stubs.

FixedNetwork-run batch capped below the owned list

The batch runner capped at 220 domains; the owned live list is 245, so 25 sites would never run in one pass.

Fix: Raised the cap to 300 to cover the full owned set in a single job.

Limited-fetch domains (13) — flagged, not failed

These are auth-walled (HTTP 401) internal subdomains. The engine reaches them, captures whatever the auth page returns, scores from connection signals, and honestly flags the limitation. No domain hard-fails.

Domain	Status	Reason recorded
book.staysandalwood.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
dev.rent.austinspring.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
dev.staysandalwood.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
finance.dotepp.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
finance.walhus.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
ladybug.walhus.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
lifelog.walhus.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
manage.austinspring.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
my.paulsfriends.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
poems.dotepp.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
rent.austinspring.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
sessions.wholetech.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.
walhus.com	HTTP 401	Site responded with HTTP 401 Unauthorized — scored from the page it returned; some checks may be limited.

Per-domain scores (238 sites)

Domain	Niche	Overall	SEO	Content	AI	Social	Tech
baylesshigh.com	bayless business	98	89	100	100	100	100
austinspring.com	robotics / AI tech	98	89	100	100	100	100
wholetx.com	villa / vacation rental	98	100	90	100	100	100
tvawardshows.com	events / entertainment	97	100	100	100	83	100
fableguide.com	fableguide business	95	89	100	100	83	100
deptless.com	restaurant / food	95	89	100	100	83	100
aiaustintexas.com	robotics / AI tech	95	100	100	100	67	100
austinblogger.com	restaurant / food	95	100	100	100	67	100
deptzy.com	restaurant / food	95	89	100	100	83	100
havelistings.com	ecommerce / retail	95	100	100	100	67	100
texascoworking.com	coworking / workspace	95	100	100	100	67	100
automarketing.wholetech.com	restaurant / food	93	78	100	100	83	100
claudefieldguide.com	ecommerce / retail	93	78	100	100	83	100
bastropfiber.com	bastrop business	93	78	100	100	83	100
automarketingdept.com	restaurant / food	93	78	100	100	83	100
snapswim.com	fitness / wellness	92	100	100	100	50	100
whensthegame.com	events / entertainment	92	100	100	100	50	100
dotepp.com	dotepp business	92	100	100	100	50	100
atemcooler.com	ecommerce / retail	92	100	100	100	50	100
austincoffeeshowdown.com	coffee shop / cafe	92	100	100	100	50	100
aiwholetech.com	robotics / AI tech	92	100	100	100	50	100
listsiam.com	robotics / AI tech	92	100	100	100	50	100
convcast.com	events / entertainment	92	89	100	100	67	100
workontheweb.com	coworking / workspace	92	100	100	100	50	100
askemai.com	coworking / workspace	92	100	100	100	50	100
stonedom.com	stonedom business	92	100	100	100	50	100
austinretire.com	travel / tourism	92	100	100	100	50	100
webgirlvillage.com	villa / vacation rental	92	100	100	100	50	100
coworkingcongress.com	coworking / workspace	92	100	100	100	50	100
chromecastcast.com	chromecastcast business	92	100	100	100	50	100
austincast.com	austin business	92	100	100	100	50	100
tagslides.com	restaurant / food	92	100	100	100	50	100
austinworking.com	austin business	92	89	100	100	67	100
austinhomesearches.com	ecommerce / retail	92	100	100	100	50	100
coworkingcamp.com	coworking / workspace	92	100	100	100	50	100
wholetech.com	coworking / workspace	92	89	100	100	67	100
robotnewsnow.com	robotics / AI tech	92	100	100	100	50	100
repeater.org	restaurant / food	92	100	100	100	50	100
texascowork.com	coworking / workspace	92	100	100	100	50	100
cybersubdivision.com	restaurant / food	92	100	100	100	50	100
tribalsurvival.com	tribal business	92	100	100	100	50	100
stumblicious.com	stumblicious business	92	100	100	100	50	100
wordpressmeetup.com	events / entertainment	92	100	100	100	50	100
pluspitch.com	coworking / workspace	92	100	100	100	50	100
neighborhell.com	real estate / property	92	100	100	100	50	100
americancoworking.com	coworking / workspace	92	100	100	100	50	100
austin.com.co	restaurant / food	92	100	100	100	50	100
austinpads.com	villa / vacation rental	92	100	100	100	50	100
podsat.com	restaurant / food	92	100	100	100	50	100
firthfan.com	news / media	92	100	100	100	50	100
wholetexas.com	restaurant / food	92	100	100	100	50	100
austenfirth.com	austen business	92	100	100	100	50	100
austintexascoworking.com	coworking / workspace	92	100	100	100	50	100
advairwater.com	restaurant / food	92	100	100	100	50	100
austinhangout.com	coffee shop / cafe	92	100	100	100	50	100
webarter.net	restaurant / food	92	100	100	100	50	100
adultstory.com	restaurant / food	92	100	100	100	50	100
far-uvclight.com	ecommerce / retail	92	100	100	100	50	100
austinlifestyles.com	restaurant / food	92	89	100	100	67	100
changebastrop.com	change business	92	100	100	100	50	100
afterstages.com	ecommerce / retail	92	100	100	100	50	100
coworkingcoalition.com	coworking / workspace	92	100	100	100	50	100
videoretreat.com	ecommerce / retail	92	100	100	100	50	100
cambridgetower.net	real estate / property	91	100	100	100	50	92
taichipaul.com	robotics / AI tech	91	89	100	92	67	100
bastroprealty.com	real estate / property	91	89	100	92	67	100
dev260515.wholetech.com	villa / vacation rental	91	89	100	92	67	100
alexsmallengine.com	ecommerce / retail	90	78	100	100	67	100
austinrepeater.com	restaurant / food	90	89	100	100	50	100
bastropbuilder.com	bastrop business	90	89	100	100	50	100
thaivillaexchange.com	villa / vacation rental	90	78	100	100	67	100
guide.bastroprealty.com	bastrop business	90	100	100	100	33	100
cargotown.com	boating / marine	90	89	100	100	50	100
thanksforclicking.net	restaurant / food	90	89	100	100	50	100
atxsportsfans.com	events / entertainment	90	78	100	100	67	100
colinfirth.org	restaurant / food	90	100	100	100	33	100
austenjane.com	austen business	90	89	100	100	50	100
austintweet.com	austin business	90	89	100	100	50	100
changeaustin.com	change business	90	89	100	100	50	100
texascoworking.org	coworking / workspace	90	89	100	100	50	100
greenhomevideo.com	green business	90	89	100	100	50	100
hotaisites.com	hotaisites business	90	100	100	100	33	100
robopodcast.com	robotics / AI tech	90	100	90	100	50	100
wordpressretreat.com	restaurant / food	90	89	100	100	50	100
atxfans.com	events / entertainment	90	78	100	100	67	100
smallhomevillages.com	villa / vacation rental	90	89	100	100	50	100
atxtechtrends.com	coworking / workspace	90	100	100	100	33	100
childrensfable.com	robotics / AI tech	90	78	100	100	67	100
earthmodel.com	earth business	90	89	100	100	50	100
auditionmodel.com	audition business	90	89	100	100	50	100
coworkingretreat.com	coworking / workspace	90	89	100	100	50	100
tvatx.com	ecommerce / retail	90	89	100	100	50	100
bmicrophone.com	bmicrophone business	90	89	100	100	50	100
austintexasfans.com	events / entertainment	90	78	100	100	67	100
paulsfriends.com	paul business	90	89	100	100	50	100
motorblade.com	motorblade business	90	100	90	100	50	100
steamlearn.com	steam business	90	89	100	100	50	100
sheyroth.com	shey business	89	89	90	92	67	100
airbnb.realhotsprings.com	villa / vacation rental	88	100	90	100	33	100
bastropstudio.com	bastrop business	88	100	90	100	33	100
flip.realhotsprings.com	real estate / property	88	100	90	100	33	100
golf.realhotsprings.com	real estate / property	88	100	90	100	33	100
downtown.realhotsprings.com	events / entertainment	88	100	90	100	33	100
bnb.realhotsprings.com	events / entertainment	88	100	90	100	33	100
colinfirth.com	colin business	88	78	100	92	67	100
tiny.realhotsprings.com	real estate / property	88	100	90	100	33	100
aquachifit.com	fitness / wellness	88	89	100	92	50	100
barneyfrauenthal.com	frauenthal business	88	78	100	92	67	100
retire.realhotsprings.com	real estate / property	88	100	90	100	33	100
newbuilds.realhotsprings.com	real estate / property	88	100	90	100	33	100
relocate.realhotsprings.com	villa / vacation rental	88	100	90	100	33	100
equestrian.realhotsprings.com	real estate / property	88	100	90	100	33	100
luxury.realhotsprings.com	villa / vacation rental	88	100	90	100	33	100
storage.realhotsprings.com	real estate / property	88	100	90	100	33	100
ehotsprings.com	real estate / property	88	100	90	100	33	100
rv.realhotsprings.com	villa / vacation rental	88	100	90	100	33	100
market.realhotsprings.com	real estate / property	88	100	90	100	33	100
ownerfinance.realhotsprings.com	real estate / property	88	100	90	100	33	100
vacation.realhotsprings.com	travel / tourism	88	100	90	100	33	100
barndo.realhotsprings.com	real estate / property	88	100	90	100	33	100
farms.realhotsprings.com	real estate / property	88	100	90	100	33	100
lake.realhotsprings.com	real estate / property	88	100	90	100	33	100
hunting.realhotsprings.com	real estate / property	88	100	90	100	33	100
commercial.realhotsprings.com	real estate / property	88	100	90	100	33	100
land.realhotsprings.com	real estate / property	88	100	90	100	33	100
historic.realhotsprings.com	real estate / property	88	100	90	100	33	100
bastropradio.com	events / entertainment	88	89	90	100	50	100
atxnews.club	news / media	88	100	80	100	50	100
foreclosures.realhotsprings.com	real estate / property	88	100	90	100	33	100
muskmile.com	news / media	88	100	90	100	33	100
starter.realhotsprings.com	real estate / property	88	100	90	100	33	100
barneyebsworth.com	barney business	87	78	100	100	50	100
bigdummiesguidetoai.com	robotics / AI tech	87	89	100	100	33	100
alexsmallenginerepair.com	ecommerce / retail	87	78	100	100	50	100
alpinevillage.wholetech.com	villa / vacation rental	87	89	100	100	33	100
texascoliving.com	restaurant / food	87	78	100	100	50	100
ai.wholetech.com	robotics / AI tech	87	89	100	100	33	100
gamesked.com	gamesked business	87	100	60	100	67	100
tinyhackerhouse.wholetech.com	events / entertainment	87	78	100	100	50	100
commercialaustin.com	real estate / property	87	78	100	100	50	100
multipolemagnets.com	events / entertainment	87	78	100	100	50	100
atxtechnewsnow.com	news / media	87	78	100	100	50	100
atxaisites.com	atxaisites business	87	89	100	100	33	100
multipolemag.com	multipole business	87	89	100	100	33	100
jane.austen.com	jane business	87	89	100	100	33	100
anilpattni.wholetech.com	villa / vacation rental	87	78	100	100	50	100
smallhomevillage.com	villa / vacation rental	87	89	100	100	33	100
austinmayor.com	coworking / workspace	87	78	100	100	50	100
tvreviewer.com	coworking / workspace	87	89	100	100	33	100
neilcronk.com	neil business	87	100	60	100	67	100
atxlot.com	ecommerce / retail	87	89	100	100	33	100
proaudiobroker.com	real estate / property	87	89	100	100	33	100
texasfridaynights.com	texas business	86	78	100	92	50	100
austen.com	ecommerce / retail	86	100	100	83	33	100
girlhoop.com	events / entertainment	86	100	100	83	33	100
childrenstory.org	childrenstory business	86	100	100	83	33	100
dev.texascoliving.com	restaurant / food	86	78	100	92	50	100
firth.com	ecommerce / retail	86	100	100	83	33	100
bastropbeat.com	restaurant / food	86	100	80	100	33	100
afterhours.party	robotics / AI tech	85	78	100	100	33	100
tvawardshow.com	events / entertainment	85	78	100	100	33	100
hulloships.com	boating / marine	85	78	100	100	33	100
pinest-tech.atxaisites.com	events / entertainment	85	78	100	100	33	100
earthscrapers.com	restaurant / food	85	78	100	100	33	100
aiwayback.com	ecommerce / retail	85	78	100	100	33	100
austintechtrends.com	founder business	85	78	100	100	33	100
campaignpromise.com	campaignpromise business	85	78	100	100	33	100
buildercamp.com	ecommerce / retail	85	78	100	100	33	100
austincribs.com	events / entertainment	85	78	100	100	33	100
cargosolar.com	boating / marine	85	78	100	100	33	100
austintechnews.live	professional services	85	78	100	100	33	100
smallhomevillage.wholetech.com	villa / vacation rental	85	78	100	100	33	100
austinfestivalcalendar.com	events / entertainment	85	100	60	100	50	100
offgridder.com	ecommerce / retail	85	78	100	100	33	100
robotnewstoday.com	robotics / AI tech	85	78	100	100	33	100
touroftexas.com	travel / tourism	85	89	100	92	33	100
hoopwomen.com	restaurant / food	84	89	100	83	33	100
atxbbs.com	atxbbs business	84	89	100	83	33	100
videoswitchguide.com	video business	84	89	100	83	33	100
asiafilmfests.com	events / entertainment	84	78	100	83	50	100
bnbhot.com	villa / vacation rental	84	89	100	83	33	100
golfcartvendors.com	ecommerce / retail	84	89	100	83	33	100
pamadamic.com	adamic business	83	100	50	100	50	100
atxengine.com	boating / marine	83	89	80	100	33	100
devautomarketing.wholetech.com	restaurant / food	83	78	100	92	33	100
alpinevillage2.wholetech.com	villa / vacation rental	83	89	80	100	33	100
tvnight.com	night business	83	78	90	100	33	100
jane.buildercamp.com	restaurant / food	82	100	100	67	33	100
dev.deptless.com	restaurant / food	82	89	100	75	33	100
wholevoyage.com	boating / marine	81	78	90	92	33	100
carolekatchen.com	carole business	81	78	100	83	33	100
realhotsprings.com	real estate / property	81	78	100	83	33	100
memsist.com	villa / vacation rental	81	78	100	83	33	100
automarketingengine.com	auto business	80	72	40	100	83	100
money.walhus.com	money business	80	89	80	83	33	100
land.wholetech.com	villa / vacation rental	80	72	100	83	33	100
staysandalwood.com	villa / vacation rental	79	78	100	75	33	100
dev.automarketingdept.com	restaurant / food	79	78	100	75	33	100
posters.wholetech.com	posters business	79	78	90	83	33	100
sandalwoodvillas.wholetech.com	villa / vacation rental	79	78	100	75	33	100
hoarder.walhus.com	restaurant / food	79	67	80	92	50	100
dev.tvreviewer.com	events / entertainment	78	89	80	75	33	100
amdept.wholetech.com	three business	78	89	80	75	33	100
ofsthai.com	real estate / property	77	67	100	75	33	100
hillrepair.com	professional services	76	56	100	83	33	100
tvshowdb.com	events / entertainment	76	89	60	83	33	100
hillcountryrepair.com	hill business	76	56	100	83	33	100
dev.austen.com	jane business	76	78	100	58	33	100
sitemap.wholetech.com	wholetech business	75	89	90	42	50	100
dev.atxengine.com	boating / marine	75	78	80	75	33	100
onpointappliance-com.redesigns.wholetech.com	restaurant / food	74	56	90	83	33	100
atxfans-com.dev.wholetech.com	events / entertainment	69	56	80	58	50	100
austintexasfans-com.dev.wholetech.com	events / entertainment	69	56	80	58	50	100
atxsportsfans-com.dev.wholetech.com	events / entertainment	69	56	80	58	50	100
polymag.automarketing.wholetech.com	polymagnet business	68	61	80	58	33	100
polymag.deptless.com	ecommerce / retail	66	50	80	58	33	100
polymag.automarketingdept.com	polymagnet business	66	50	80	58	33	100
dev.listsiam.com	real estate / property	61	56	50	58	33	100
dev.wholetech.com	wholetech business	61	56	70	42	33	100
lifecycletransitions-com.hoarders.dev.wholetech.com	proposal business	61	56	50	58	33	100
search.wholetech.com	wholetech business	58	33	40	75	33	100
invoices.austinspring.com	invoice business	57	56	20	67	33	100
childrenstory.net	children business	52	56	30	75	33	58
hermes.wholetech.com	nginx business	49	56	20	58	50	58
austen.live	small business	43	33	20	67	33	58
book.staysandalwood.comlimited	authorization business	36	39	20	42	33	42
ladybug.walhus.comlimited	authorization business	36	39	20	42	33	42
rent.austinspring.comlimited	authorization business	36	39	20	42	33	42
dev.staysandalwood.comlimited	authorization business	36	39	20	42	33	42
sessions.wholetech.comlimited	authorization business	36	39	20	42	33	42
lifelog.walhus.comlimited	authorization business	36	39	20	42	33	42
finance.walhus.comlimited	authorization business	36	39	20	42	33	42
my.paulsfriends.comlimited	authorization business	36	39	20	42	33	42
poems.dotepp.comlimited	authorization business	36	39	20	42	33	42
dev.rent.austinspring.comlimited	authorization business	36	39	20	42	33	42
manage.austinspring.comlimited	authorization business	36	39	20	42	33	42
walhus.comlimited	authorization business	36	39	20	42	33	42
finance.dotepp.comlimited	authorization business	36	39	20	42	33	42