Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions apps/sim/app/(landing)/comparison/comparison-sections.ts
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,7 @@ export const COMPARISON_SECTIONS: ComparisonSectionDef[] = [
{ key: 'asyncExecution', label: 'Async execution' },
{ key: 'executionLimits', label: 'Execution limits' },
{ key: 'partialFailureHandling', label: 'Partial-failure handling' },
{ key: 'unattendedExecution', label: 'Unattended execution' },
],
}),
defineSection({
Expand Down
24 changes: 20 additions & 4 deletions apps/sim/lib/compare/data/competitors/claude-cowork.ts
Original file line number Diff line number Diff line change
Expand Up @@ -577,7 +577,8 @@ export const claudeCoworkProfile: CompetitorProfile = {
},
integrations: {
integrationCount: {
value: '200+ connectors (third-party estimate; Anthropic does not publish an exact figure)',
value:
"200+ connectors (estimated from Anthropic's own Connectors Directory; Anthropic does not publish an exact figure)",
detail:
"Anthropic's Connectors Directory lists connectors like Linear, Slack, Google Drive, Google Workspace, and Microsoft 365, but no primary Anthropic page states a total count.",
shortValue: '200+ connectors (estimated)',
Expand Down Expand Up @@ -876,10 +877,10 @@ export const claudeCoworkProfile: CompetitorProfile = {
},
thirdPartyVetting: {
value:
'Partial: Anthropic maintains first-party catalogs (anthropics/skills, anthropics/knowledge-work-plugins, the 11 plugins bundled into Cowork), but the plugin/skill ecosystem is open by design. Any developer can host a plugin marketplace as a git repo, and users add it via `/plugin marketplace add`, with no Anthropic approval queue or review gate before installation.',
"Partial: Anthropic maintains first-party catalogs (anthropics/skills, anthropics/knowledge-work-plugins, the 11 plugins bundled into Cowork), but the plugin/skill ecosystem is open by design. Any developer can host a plugin marketplace as a git repo, and users add it via `/plugin marketplace add`, with no Anthropic approval queue or review gate before installation. A third-party security audit has already found malicious entries in that broader ecosystem: Snyk's ToxicSkills research scanned ~3,984 skills on ClawHub and skills.sh (third-party marketplaces that also serve Claude Code users) and confirmed 76 malicious skills, with 1,467 flagged for security issues.",
detail:
'Third-party community sites (ClawHub, skills.sh, and others) distribute unvetted, community-authored skills for Claude Code/Cowork. Snyk\'s ToxicSkills audit of ~3,984 skills on ClawHub and skills.sh found 1,467 with security flaws and confirmed 76 active malicious payloads built for credential theft, backdoors, and data exfiltration. Koi Security separately audited all 2,857 skills on ClawHub and flagged 341 as malicious, 335 tied to one coordinated campaign ("ClawHavoc"). These incidents sit in the broader Claude Skills/plugin ecosystem, not Anthropic\'s own first-party catalog.',
shortValue: 'Partial: first-party catalog + open, unvetted plugin ecosystem',
"This incident sits in the broader Agent Skills ecosystem across third-party marketplaces, not Anthropic's own first-party catalog, but it shows real, sourced supply-chain risk adjacent to Cowork's installable-skill model. By contrast, every one of Sim's blocks is first-party authored and code-reviewed through the standard pull-request process in the main Sim repository; there is no public marketplace where an arbitrary third party can publish and have other users install executable block code without going through Sim's own review.",
shortValue: 'Partial: open plugin ecosystem with a documented malicious-skill incident',
confidence: 'verified',
sources: [
{
Expand Down Expand Up @@ -1045,6 +1046,21 @@ export const claudeCoworkProfile: CompetitorProfile = {
},
],
},
unattendedExecution: {
value:
'No: scheduled tasks require the Claude Desktop app open and the computer awake on the client device',
detail:
"There is no server-side execution path independent of the client. A scheduled/recurring task only fires while the desktop app is running and the machine is awake; if the device sleeps or the app is closed when a run is due, that run is skipped and auto-executed on next wake, with a notification, rather than firing on schedule from infrastructure independent of the user's machine.",
shortValue: 'No: requires desktop app open and computer awake',
confidence: 'verified',
sources: [
{
url: 'https://support.claude.com/en/articles/13854387-schedule-recurring-tasks-in-claude-cowork',
label: 'Schedule recurring tasks in Claude Cowork',
asOf: '2026-07-02',
},
],
},
},
support: {
supportChannels: {
Expand Down
91 changes: 56 additions & 35 deletions apps/sim/lib/compare/data/competitors/crewai.ts
Original file line number Diff line number Diff line change
Expand Up @@ -18,35 +18,35 @@ export const crewaiProfile: CompetitorProfile = {
},
standoutFeatures: [
{
title: 'Dual programming model: autonomous Crews plus event-driven Flows',
title: 'Code-first Python framework, not a visual builder',
description:
'CrewAI gives developers two composable abstractions: Crews, teams of role-based agents with autonomy over how a task gets done, and Flows, an event-driven layer (Python decorators like @start, @listen, @router) for deterministic control over state and execution order. Flows can orchestrate one or more Crews, mixing free-form agent reasoning with explicit procedural logic in the same application.',
shortDescription: 'Combines autonomous agent Crews with deterministic, event-driven Flows.',
'CrewAI is written and configured entirely in Python. Developers get two composable abstractions in code: Crews, teams of role-based agents with autonomy over how a task gets done, and Flows, an event-driven layer (Python decorators like @start, @listen, @router) for deterministic control over state and execution order. There is no visual canvas in the open-source core; a team that wants full programmatic control over multi-agent orchestration logic, with no drag-and-drop layer at all, gets that directly.',
shortDescription: 'Fully code-based multi-agent orchestration, with no visual canvas at all.',
source: {
url: 'https://docs.crewai.com/en/concepts/flows',
label: 'Flows - CrewAI Docs',
asOf: '2026-07-02',
},
},
{
title: 'Independent of LangChain, built from scratch',
title: 'Large, fast-growing open-source community',
description:
'CrewAI is a standalone Python framework, independent of LangChain or other agent frameworks, with a lighter dependency footprint and its own LLM connection layer: native integrations for OpenAI, Anthropic, Gemini, and Bedrock, plus LiteLLM for 200+ additional providers.',
shortDescription: 'A standalone framework, not built on top of LangChain.',
'The crewAIInc/crewAI GitHub repository has surpassed 54,800 stars and is MIT licensed, one of the most-starred open-source multi-agent orchestration frameworks. CrewAI reports its open-source framework executes over 10 million agents per month and is used by roughly half of the Fortune 500.',
shortDescription: '54,800+ GitHub stars, MIT licensed, widely adopted.',
source: {
url: 'https://docs.crewai.com/en/concepts/llms',
label: 'LLMs - CrewAI Docs',
url: 'https://github.com/crewAIInc/crewAI',
label: 'crewAIInc/crewAI (GitHub)',
asOf: '2026-07-02',
},
},
{
title: 'Large, fast-growing open-source community',
title: 'Independent of LangChain, built from scratch',
description:
'The crewAIInc/crewAI GitHub repository has surpassed 54,800 stars and is MIT licensed, one of the most-starred open-source multi-agent orchestration frameworks. CrewAI reports its open-source framework executes over 10 million agents per month and is used by roughly half of the Fortune 500.',
shortDescription: '54,800+ GitHub stars, MIT licensed, widely adopted.',
'CrewAI is a standalone Python framework, independent of LangChain or other agent frameworks, with a lighter dependency footprint and its own LLM connection layer: native integrations for OpenAI, Anthropic, Gemini, and Bedrock, plus LiteLLM for 200+ additional providers.',
shortDescription: 'A standalone framework, not built on top of LangChain.',
source: {
url: 'https://github.com/crewAIInc/crewAI',
label: 'crewAIInc/crewAI (GitHub)',
url: 'https://docs.crewai.com/en/concepts/llms',
label: 'LLMs - CrewAI Docs',
asOf: '2026-07-02',
},
},
Expand Down Expand Up @@ -781,16 +781,17 @@ export const crewaiProfile: CompetitorProfile = {
],
},
auditLogging: {
value: 'Yes: audit trails are listed among CrewAI AMP Enterprise security features',
value:
'Partial: immutable audit trails are described as part of CrewAI AMP Enterprise IAM, but not by a first-party source',
detail:
"CrewAI Enterprise lists audit trails alongside PII detection/masking, secret manager integration, and SSO as built-in Enterprise-tier security features. CrewAI's own pricing page does not itemize audit-log retention windows or export formats.",
shortValue: 'Yes, as an AMP Enterprise feature; retention details unconfirmed',
"Third-party CrewAI production write-ups describe Enterprise-tier IAM as including SSO, RBAC, and immutable audit trails, alongside PII redaction and secret manager integration, but CrewAI's own docs and pricing page do not independently itemize audit-log retention windows or export formats, so this is treated as unconfirmed by a first-party source.",
shortValue: 'Partial, described in third-party write-ups; not independently confirmed',
confidence: 'estimated',
sources: [
{
url: 'https://cybernews.com/ai-tools/crewai-review/',
label: 'CrewAI Review 2026 - CyberNews',
asOf: '2026-07-02',
url: 'https://techjacksolutions.com/ai-tools/crewai/crewai-production-guide/',
label: 'CrewAI in Production: Deployment, Monitoring & Scaling - TechJack Solutions',
asOf: '2026-07-04',
},
],
},
Expand Down Expand Up @@ -824,16 +825,16 @@ export const crewaiProfile: CompetitorProfile = {
},
credentialGovernance: {
value:
'Yes: AMP Enterprise documents secret manager integration for governing stored credentials',
'Yes: AMP Enterprise documents secret manager integrations (e.g. Google Cloud Secret Manager) for governing stored credentials',
detail:
"CrewAI Enterprise lists secret manager integration among its built-in security features, implying centralized credential storage/access rather than credentials embedded in code. Fine-grained per-role restriction of which specific credential a role may use is not itemized in CrewAI's own documentation.",
"CrewAI's own docs describe connecting a cloud secret manager (documented for Google Cloud Secret Manager) so secrets are stored centrally rather than embedded in code, with RBAC permissions (secret_providers: manage) gating which org members can configure these integrations. Fine-grained per-role restriction of which specific credential a role may use beyond that permission is not itemized in CrewAI's own documentation.",
shortValue: 'Yes, secret manager integration (Enterprise); role-level detail unconfirmed',
confidence: 'estimated',
confidence: 'verified',
sources: [
{
url: 'https://cybernews.com/ai-tools/crewai-review/',
label: 'CrewAI Review 2026 - CyberNews',
asOf: '2026-07-02',
url: 'https://docs.crewai.com/en/enterprise/features/secrets-manager/gcp',
label: 'Google Cloud Secret Manager - CrewAI Docs',
asOf: '2026-07-04',
},
],
},
Expand All @@ -855,16 +856,16 @@ export const crewaiProfile: CompetitorProfile = {
},
piiRedaction: {
value:
'Yes: PII detection and masking is a documented CrewAI AMP Enterprise security feature',
'Yes: PII Redaction for Traces is a documented CrewAI AMP Enterprise security feature',
detail:
"CrewAI Enterprise lists 'PII detection and masking' among its built-in security features, alongside audit trails and secret manager integration. Separately, the framework's LLM-based task guardrails can be configured to check for PII exposure as one of several natural-language validation criteria, though that is a general-purpose guardrail, not dedicated PII tooling.",
shortValue: 'Yes, PII detection/masking is an AMP Enterprise feature',
confidence: 'estimated',
"CrewAI's own docs describe PII Redaction for Traces, an Enterprise-tier feature that automatically detects and masks personally identifiable information (credit card numbers, social security numbers, emails, names) in crew and flow execution traces, with support for custom recognizers. Separately, the framework's LLM-based task guardrails can be configured to check for PII exposure as one of several natural-language validation criteria, though that is a general-purpose guardrail, not dedicated PII tooling.",
shortValue: 'Yes, PII Redaction for Traces is an AMP Enterprise feature',
confidence: 'verified',
sources: [
{
url: 'https://cybernews.com/ai-tools/crewai-review/',
label: 'CrewAI Review 2026 - CyberNews',
asOf: '2026-07-02',
url: 'https://docs.crewai.com/en/enterprise/features/pii-trace-redactions',
label: 'PII Redaction for Traces - CrewAI Docs',
asOf: '2026-07-04',
},
],
},
Expand Down Expand Up @@ -1003,6 +1004,26 @@ export const crewaiProfile: CompetitorProfile = {
},
],
},
unattendedExecution: {
value:
'Yes for crews deployed to CrewAI AMP; the self-hosted open-source framework has no built-in scheduler of its own',
detail:
"A crew deployed to CrewAI AMP runs as a server-side job on CrewAI's own infrastructure, triggered by its kickoff API, a webhook, or a third-party scheduler (ActivePieces, Zapier, Make.com) calling that API; no client device needs to stay open for that run to fire or complete. The self-hosted open-source framework, by contrast, has no first-party scheduling daemon: a crew or flow only runs when something (a cron job, a long-running script, or a developer's own process) invokes it on a machine the operator keeps running, so unattended execution there depends on infrastructure the developer sets up themselves, not a client device.",
shortValue: 'Yes on AMP (server-side); self-hosted OSS needs your own scheduler/server',
confidence: 'estimated',
sources: [
{
url: 'https://docs.crewai.com/en/enterprise/guides/webhook-automation',
label: 'Webhook Automation - CrewAI Docs',
asOf: '2026-07-02',
},
{
url: 'https://docs.crewai.com/enterprise/guides/use-crew-api',
label: 'Trigger Deployed Crew API - CrewAI Docs',
asOf: '2026-07-02',
},
],
},
},
support: {
supportChannels: {
Expand Down Expand Up @@ -1070,9 +1091,9 @@ export const crewaiProfile: CompetitorProfile = {
confidence: 'estimated',
sources: [
{
url: 'https://docs.crewai.com/en/concepts/agents',
label: 'Agents - CrewAI Docs',
asOf: '2026-07-02',
url: 'https://learn.crewai.com',
label: 'CrewAI Academy (learn.crewai.com)',
asOf: '2026-07-04',
},
],
},
Expand Down
Loading
Loading