User-agent: * Disallow: /application Disallow: /dev Disallow: /themes Disallow: /tenants-files