According to @karpathy, the newly released llm-council web app enables real-time comparison and collaborative evaluation of leading large language models (LLMs) including OpenAI GPT-5.1, Google Gemini 3 Pro Preview, Anthropic Claude Sonnet 4.5, and xAI Grok-4 by dispatching user queries to all models simultaneously via OpenRouter (source: @karpathy, Twitter). Each model anonymously reviews and ranks peers’ responses, followed by a 'Chairman LLM' synthesizing a final answer, offering a transparent and structured approach to model benchmarking and qualitative assessment. This open-source tool (available on GitHub) highlights business opportunities in LLM ensemble systems, streamlining model selection and performance analysis for enterprises, AI developers, and researchers (source: @karpathy, Twitter).