MegaMart
The MegaMart platform functions as an online marketplace that allows users to browse a wide variety of products, check availability, manage orders, and choose between delivery or in-store pickup.
Overview
FeaturesSearch / Filter, Product Comparison, Variant Selection…
Tasks30 prompts and verifiers
Leaderboard
Overall Pass Rate (pass@8)
gpt-computer-use-preview
48.33%
claude-sonnet-4
47.08%
gemini-2
40.00%
Evaluation Results
Easy: 66.7% < Pass@8 ≤ 100%
Medium: 33.3% < Pass@8 < 66.6% AND Median Steps ≤ 80
Hard: Pass@8 ≤ 33.3% OR Median Steps > 80
This model: 12 easy · 4 medium · 14 hard tasks
#1gpt-computer-use-preview
Pass rate: 48.33%
Capabilities
Product Discovery
Search / Filter
Browse by category or price.
Product Comparison
View feature differences.
PDP & Variants
Variant Selection
Choose options like size/color.
Product Media
Access images/videos.
Cart & Checkout
Apply Promo Code
Validate coupons.
Checkout Flow
Confirm address and payment.
Fulfillment
Delivery / Pickup
Choose shipping or store pickup.
Returns
Initiate Return
Select reason and refund type.
Demo Execution
Watch how an AI agent interacts with this environment
Prompt
I'm considering buying the Panasonic projector for my home setup. Is it worth the price, and would it work well in a small room? Help me decide if I should get it.
Loading timeline...