Skip to content

Inspecting Live Resources

Quick-reference for agents investigating issues across the Cloud Control Plane infrastructure.

Environment Quick Reference

Env AWS Account Region Default CLI Profile
Staging 468036072962 us-east-1 Default
Preprod 010928202142 us-east-1 Requires --profile
Prod 023568249301 us-east-1 Requires --profile

Cloudflare accounts: 3a8e992c9f607dcb3b401878264df92e (dev/staging/preprod), 96d9ae8ad2fe71a3c6ead54f3a775c05 (prod).

Naming Convention

Most AWS resources follow {env_prefix}-{ResourceName}:

  • Dev: dev-{branch}- (e.g., dev-oliver-EcomIndexSettingsTable)
  • Staging: staging-
  • Preprod: preprod-
  • Prod: prod-

Exception: UsersAccountsTable has no prefix in staging.

End-to-End Flow Guides

Trace a customer action through every service hop, with what to check at each step:

Flow Description
Search Search query through proxy → KV → Marqo and back
Add Documents Product sync from Shopify → S3 → SQS → Indexer → Marqo
Recommendations Similar, suggestions, and personalized recommendations
Agentic Search AI search with Gemini, caching, conversations
Signup Registration through Cognito, Stripe, DynamoDB
Login Authentication and API authorization
Settings Sync DynamoDB → settings exporter → Cloudflare KV

Start Here: Which Component?

If the issue involves... Start with
Search queries, results, latency Search Proxy
AI/conversational search Agentic Search
Product indexing, Shopify sync Ecommerce
Admin dashboard, query configs, forks Admin
User signup, login, accounts, billing Controller
Console web app, monolith API Control Plane

Resource Type Guides

How to inspect each type of resource with CLI commands:

Resource Guide
DynamoDB tables resources/dynamodb.md
Lambda functions resources/lambda.md
API Gateway resources/api-gateway.md
Cloudflare Workers / KV / DO resources/cloudflare-workers.md
CloudWatch (logs, alarms, dashboards) resources/cloudwatch.md
Cognito (user pools, auth) resources/cognito.md
S3 buckets resources/s3.md
SQS queues resources/sqs.md
Secrets Manager resources/secrets-manager.md
ECS / Fargate resources/ecs.md
Elastic Beanstalk resources/elastic-beanstalk.md
WAF resources/waf.md

Data Plane Cell Gateways

IAM-authenticated API Gateway endpoints per data plane cell. Config lives in infra/*/config/{env}.json under data_plane_cells.

Cell Gateway ID Account
S (staging) 9ok9ywt6u5 468036072962
PP (preprod) me25xyukr9 010928202142
P1 (prod) m6j1teqnte 023568249301

Invoke with IAM auth:

python3 -c "
import requests, json
from aws_requests_auth.boto_utils import BotoAWSRequestsAuth
host = '9ok9ywt6u5.execute-api.us-east-1.amazonaws.com'
auth = BotoAWSRequestsAuth(aws_host=host, aws_region='us-east-1', aws_service='execute-api')
resp = requests.post(f'https://{host}/prod/v2/indexes/list', auth=auth,
                     json={'systemAccountId': 'fnqm9psx'})
print(json.dumps(resp.json(), indent=2))
"

Common Investigation Patterns

"Why is search returning wrong/stale results?"

  1. Check index settings in DDB: DynamoDB -> EcomIndexSettingsTable
  2. Check KV cache: Cloudflare Workers
  3. Check settings exporter: Lambda -> EcomSettingsExporterLambda
  4. Check search proxy logs: Cloudflare Workers -> {env}-ecom-api

"Why is indexing stuck?"

  1. Check indexer jobs: DynamoDB -> EcomIndexerJobsTable
  2. Check indexer Lambda: Lambda -> EcomIndexerFunction
  3. Check SQS queue depth: SQS
  4. Check product data: S3 -> ecom-product-data-bucket

"Why can't a user sign in?"

  1. Check Cognito user: Cognito
  2. Check auth Lambda logs: Lambda -> ControllerAuthLambda-{env}
  3. Check controller health: Elastic Beanstalk

"Why is the admin dashboard broken?"

  1. Check admin worker: Cloudflare Workers -> {env}-admin-api
  2. Check admin Lambda: Lambda -> AdminLambda
  3. Check API Gateway: API Gateway -> AdminInternalApi

"Why are alarms firing?"

  1. Check alarm state: CloudWatch
  2. Follow the alarm to its source metric/resource
  3. Check associated Lambda/service logs

Infrastructure Code Locations

Component CDK/Pulumi Config
Control Plane (Console) infra/aws/stacks/ infra/aws/config/
Ecommerce infra/ecom/stacks/ infra/ecom/config/
Admin infra/admin/stacks/ infra/admin/config/
Controller infra/controller/stacks/ infra/controller/configurations/
Cloudflare Workers components/{worker}/wrangler.toml Per-env sections in wrangler.toml