-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
8 changed files
with
925 additions
and
500 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,6 +1 @@ | ||
| <!doctype html><html><head><meta charset="utf-8"/><meta name="description" content="FIXME"/><meta name="keywords" content="FIXME, FIXME, FIXME"/><meta name="viewport" content="width=device-width,initial-scale=1"/><title>LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code</title><link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro" rel="stylesheet"/><link rel="stylesheet" href="./css/bulma.min.css"/><link rel="stylesheet" href="./css/bulma-carousel.min.css"/><link rel="stylesheet" href="./css/bulma-slider.min.css"/><link rel="stylesheet" href="./css/fontawesome.all.min.css"/><link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css"/><link rel="stylesheet" href="./css/index.css"/><link rel="icon" href="./images/favicon.svg"/><script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script><script defer="defer" src="./js/fontawesome.all.min.js"></script><script src="./js/bulma-carousel.min.js"></script><script src="./js/bulma-slider.min.js"></script><script src="./js/index.js"></script><script defer="defer" src="./static/js/main.b2a95633.js"></script><link href="./static/css/main.28b2e96e.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div><nav class="navbar" role="navigation" aria-label="main navigation"><div class="navbar-brand"><a role="button" class="navbar-burger" aria-label="menu" aria-expanded="false"><span aria-hidden="true"></span> <span aria-hidden="true"></span> <span aria-hidden="true"></span></a></div><div class="navbar-menu"><div class="navbar-start" style="flex-grow:1;justify-content:center"><a class="navbar-item" href="https://keunhong.com"><span class="icon"><i class="fas fa-home"></i></span></a><div class="navbar-item has-dropdown is-hoverable"><a class="navbar-link">More Research</a><div class="navbar-dropdown"><a class="navbar-item" href="https://hypernerf.github.io">HyperNeRF </a><a class="navbar-item" href="https://nerfies.github.io">Nerfies </a><a class="navbar-item" href="https://latentfusion.github.io">LatentFusion </a><a class="navbar-item" href="https://photoshape.github.io">PhotoShape</a></div></div></div></div></nav><section class="hero"><div class="hero-body"><div class="container is-max-desktop"><div class="columns is-centered"><div class="column has-text-centered"><h1 class="title is-1 publication-title">LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code</h1><div class="is-size-5 publication-authors"><span class="author-block"><a href="FIXME">Naman Jain</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">King Han</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Alex Gu</a><sup>2</sup>,</span> <span class="author-block"><a href="FIXME">Wen-Ding Li</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Fanjia Yan</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Tianjun Zhang</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Sida Wang</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Armando Solar-Lezama</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Koushik Sen</a><sup>1</sup>,</span> <span class="author-block"><a href="FIXME">Ion Stoica</a><sup>1</sup></span></div><div class="is-size-5 publication-authors"><span class="author-block"><sup>1</sup>University of California, Berkeley</span> <span class="author-block"><sup>2</sup>MIT</span></div><div class="column has-text-centered"><div class="publication-links"><span class="link-block"><a href="FIXME" class="external-link button is-normal is-rounded is-dark"><span class="icon"><i class="fas fa-file-pdf"></i> </span><span>Paper</span> </a></span><span class="link-block"><a href="FIXME" class="external-link button is-normal is-rounded is-dark"><span class="icon"><i class="fab fa-github"></i> </span><span>Code</span> </a></span><span class="link-block"><a href="FIXME" class="external-link button is-normal is-rounded is-dark"><span class="icon"><i class="far fa-images"></i> </span><span>Data</span></a></span></div></div></div></div></div></div></section><section class="hero teaser"><div class="container is-max-desktop"><div class="hero-body">FIXME<h2 class="subtitle has-text-centered"><span class="dnerf">LiveCodeBench</span> FIXME</h2></div></div></section><section class="section"><div class="container is-max-desktop"><div class="columns is-centered has-text-centered"><div class="column is-four-fifths"><h2 class="title is-3">Abstract</h2><div class="content has-text-justified"><p>Lorem ipsum dolor sit amet consectetur adipisicing elit. Earum, voluptatibus nam explicabo, quod animi iusto cupiditate consequuntur quia nulla ut at iure vitae facere est consequatur fuga molestiae error asperiores!</p><p>Lorem ipsum dolor sit amet consectetur adipisicing elit. Nisi recusandae ipsam doloribus quis accusantium harum explicabo molestias voluptates placeat reprehenderit fugiat voluptas voluptate, repudiandae neque, voluptatibus dignissimos eum similique ratione.</p><p>We show that <span class="dnerf">LiveCodeBench</span> can turn Lorem ipsum dolor sit amet consectetur adipisicing elit. Voluptate rerum quam quaerat libero sequi tempora labore aspernatur modi pariatur aut magnam delectus officiis repellat, quidem eaque voluptates. Animi, consequatur eos.</p></div></div></div></div></section><section class="section"><div class="container is-max-desktop"><div class="columns is-centered has-text-centered"><div class="column is-four-fifths"><h2 class="title is-3">Abstract</h2><div class="content has-text-justified"><p>Lorem ipsum dolor sit amet consectetur adipisicing elit. Earum, voluptatibus nam explicabo, quod animi iusto cupiditate consequuntur quia nulla ut at iure vitae facere est consequatur fuga molestiae error asperiores!</p><p>Lorem ipsum dolor sit amet consectetur adipisicing elit. Nisi recusandae ipsam doloribus quis accusantium harum explicabo molestias voluptates placeat reprehenderit fugiat voluptas voluptate, repudiandae neque, voluptatibus dignissimos eum similique ratione.</p><p>We show that <span class="dnerf">LiveCodeBench</span> can turn Lorem ipsum dolor sit amet consectetur adipisicing elit. Voluptate rerum quam quaerat libero sequi tempora labore aspernatur modi pariatur aut magnam delectus officiis repellat, quidem eaque voluptates. Animi, consequatur eos.</p></div></div></div></div></section><section class="section" id="BibTeX"><div class="container is-max-desktop content"><h2 class="title">BibTeX</h2><pre><code>@article{FIXME, | ||
| author = {Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, Ion Stoica}, | ||
| title = {LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code}, | ||
| journal = {FIXME}, | ||
| year = {2024}, | ||
| }</code></pre></div></section><footer class="footer"><div class="container"><div class="content has-text-centered"><a class="icon-link" href="FIXME"><i class="fas fa-file-pdf"></i> </a><a class="icon-link" href="FIXME"><i class="fab fa-github"></i></a></div><div class="columns is-centered"><div class="column is-8"><div class="content"><p>This website is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>.</p><p>This means you are free to borrow the <a href="https://github.com/LiveCodeBench/livecodebench.github.io">source code</a> of this website, we just ask that you link back to this page in the footer. Please remember to remove the analytics code included in the header of the website which you do not want on your website.</p></div></div></div></div></footer></body></html> | ||
| <!doctype html><html lang="en"><head><title>Streamlit Component</title><meta charset="UTF-8"/><meta name="viewport" content="width=device-width,initial-scale=1"/><meta name="theme-color" content="#000000"/><meta name="description" content="Streamlit Component"/><link rel="stylesheet" href="bootstrap.min.css"/><script defer="defer" src="./static/js/main.b2a95633.js"></script><link href="./static/css/main.28b2e96e.css" rel="stylesheet"></head><body><noscript>You need to enable JavaScript to run this app.</noscript><div id="root"></div></body></html> |
Oops, something went wrong.