Skip to content

Commit 9670af4

Browse files
committed
added results on cc for librarian
1 parent 22d5537 commit 9670af4

File tree

1 file changed

+44
-3
lines changed

1 file changed

+44
-3
lines changed

index.html

Lines changed: 44 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -311,6 +311,48 @@ <h2 id="results">Results</h2>
311311
<figcaption style="text-align: center;">Table 2: Results on the MiniCode CodeContests split</figcaption>
312312
</figure>
313313

314+
<figure class="table-figure">
315+
<table class="table-styled">
316+
<thead>
317+
<tr>
318+
<th><strong>Metric</strong></th>
319+
<th><strong>Value</strong></th>
320+
</tr>
321+
</thead>
322+
<tbody>
323+
<tr>
324+
<td>Pass Rate</td>
325+
<td>90.67% ±1.88</td>
326+
</tr>
327+
<tr>
328+
<td>Pass Rate Improvement (over non-refactored)</td>
329+
<td>6.33% ±1.41</td>
330+
</tr>
331+
<tr>
332+
<td>MDL Ratio</td>
333+
<td>0.53 ±0.03</td>
334+
</tr>
335+
<tr>
336+
<td>Token Ratio</td>
337+
<td>0.66 ±0.04</td>
338+
</tr>
339+
<tr>
340+
<td># of Library Functions</td>
341+
<td>10.30 ±1.41</td>
342+
</tr>
343+
<tr>
344+
<td>Avg Calls per Function</td>
345+
<td>5.17 ±1.08</td>
346+
</tr>
347+
<tr>
348+
<td>% Single Use Functions</td>
349+
<td>38.03% ±4.88</td>
350+
</tr>
351+
</tbody>
352+
</table>
353+
<figcaption style="text-align: center;">Table 3: Refactoring results for LIBRARIAN (w/ K = 8) averaged over 10 Code Contests collections</figcaption>
354+
</figure>
355+
314356
Check out the paper for the full CodeContests results, as well as repository results!
315357
</section>
316358

@@ -339,9 +381,8 @@ <h2 id="acknowledgments">Acknowledgments</h2>
339381
</main>
340382

341383
<footer>
342-
<p class="license">This website is licensed under a <a href="https://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>.</p>
343-
<p class="license">This means you are free to borrow the source code of this website, we just ask that you link back to this page in the footer. Please remember to remove the analytics code included in the header of the website which you do not want on your website.</p>
344-
<p class="license">This website template is inspired by <a href="https://nerfies.github.io/">Nerfies</a> and <a href="https://imaging.cs.cmu.edu/">CMU Computational Imaging Lab</a> research pages.</p>
384+
<!-- <p class="license">This website is licensed under a <a href="https://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>.</p> -->
385+
<!-- <p class="license">This means you are free to borrow the source code of this website, we just ask that you link back to this page in the footer. Please remember to remove the analytics code included in the header of the website which you do not want on your website.</p> -->
345386
<p class="license">Website template from <a href="https://github.com/zzigak/research-project-website">research-project-website</a>.</p>
346387
</footer>
347388
<script src="./script.js"></script>

0 commit comments

Comments
 (0)