Growing India News, world news, nation news, our news, people's news, grow news, entertainment, fashion, movies, tech, automobile and many more..
Saturday, August 26, 2023
Show HN: Display primary keys the way humans and developers prefer https://ift.tt/5ITpe0A
Show HN: Display primary keys the way humans and developers prefer https://ift.tt/RsAYJ86 August 26, 2023 at 03:20PM
Show HN: AhaApple – AI Idea Generator. One Click, Many Creative and Novel Ideas https://ift.tt/CAMzgnI
Show HN: AhaApple – AI Idea Generator. One Click, Many Creative and Novel Ideas AhaApple. AI Idea Generator. One click, Many Creative and Novel Ideas. Leveraging AI, many brainstorming techniques, and many innovative techniques, AhaApple make it easy for you to gain more inspirations and ideas. https://ift.tt/URtpoTm August 26, 2023 at 10:22AM
Show HN: Full list of ChatGPT Plugins and stats https://ift.tt/hwGAq4z
Show HN: Full list of ChatGPT Plugins and stats https://ift.tt/USv92kK August 25, 2023 at 09:12PM
Show HN: Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B https://ift.tt/2bm4nYs
Show HN: Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B Hi HN, We have fine-tuned CodeLlama-34B and CodeLlama-34B-Python on an internal Phind dataset that achieved 67.6% and 69.5% pass@1 on HumanEval, respectively. GPT-4 achieved 67%. To ensure result validity, we applied OpenAI's decontamination methodology to our dataset. The CodeLlama models released yesterday demonstrate impressive performance on HumanEval. - CodeLlama-34B achieved 48.8% pass@1 on HumanEval - CodeLlama-34B-Python achieved 53.7% pass@1 on HumanEval We have fine-tuned both models on a proprietary dataset of ~80k high-quality programming problems and solutions. Instead of code completion examples, this dataset features instruction-answer pairs, setting it apart structurally from HumanEval. We trained the Phind models over two epochs, for a total of ~160k examples. LoRA was not used — both models underwent a native fine-tuning. We employed DeepSpeed ZeRO 3 and Flash Attention 2 to train these models in three hours using 32 A100-80GB GPUs, with a sequence length of 4096 tokens. Furthermore, we applied OpenAI's decontamination methodology to our dataset to ensure valid results, and found no contaminated examples. The methodology is: - For each evaluation example, we randomly sampled three substrings of 50 characters or used the entire example if it was fewer than 50 characters. - A match was identified if any sampled substring was a substring of the processed training example. For further insights on the decontamination methodology, please refer to Appendix C of OpenAI's technical report. Presented below are the pass@1 scores we achieved with our fine-tuned models: - Phind-CodeLlama-34B-v1 achieved 67.6% pass@1 on HumanEval - Phind-CodeLlama-34B-Python-v1 achieved 69.5% pass@1 on HumanEval Note on GPT-4 According to the official technical report in March, OpenAI reported a pass@1 score of 67% for GPT-4's performance on HumanEval. Since then, there have been claims reporting higher scores. However, it's essential to note that there hasn't been any concrete evidence pointing towards an enhancement in the model's coding abilities since then. It's also crucial to highlight that these elevated figures lack the rigorous contamination analysis that the official statistic underwent, making them less of a reliable comparison. As a result, we consider 67% as the pass@1 score for GPT-4. Download We are releasing both models on Huggingface for verifiability and to bolster the open-source community. We welcome independent verification of results. Phind-CodeLlama-34B-v1: https://ift.tt/Qmw5nDN Phind-CodeLlama-34B-Python-v1: https://ift.tt/VmWcrbA We'd love to hear your thoughts! Best, The Phind Team https://ift.tt/aWsm6SC August 26, 2023 at 03:38AM
Show HN: Mail Memories – Export your email photos https://ift.tt/DIEmUzY
Show HN: Mail Memories – Export your email photos Hey HN, I’m Carlos, the maker behind Mail Memories ( https://ift.tt/Js80MyO ), a web app that helps you find and save photos from your (Gmail) email. The app connects with your email account, finds all the images you’ve received and shows them in a gallery where you can view and download the ones you want to save. I made this out of curiosity, just to see what pictures were in my account when I first signed up for Gmail 18 years ago. I ended up finding photos of my grandmother and other family members, and old friends and colleagues I’d completely forgotten about. I was surprised by what I found, I hope you will be too. Can’t wait to hear your thoughts. Demo: https://ift.tt/ZVSkeRP https://ift.tt/Js80MyO August 26, 2023 at 12:42AM
Friday, August 25, 2023
Show HN: Budget Zen – Simple, Encrypted Budgets and Expenses https://ift.tt/eIDVqJP
Show HN: Budget Zen – Simple, Encrypted Budgets and Expenses https://budgetzen.net August 25, 2023 at 02:57PM
Show HN: JSON Wrapper for React Native https://ift.tt/qjbiTZ9
Show HN: JSON Wrapper for React Native https://ift.tt/1Ze6VCF August 25, 2023 at 10:56AM
Subscribe to:
Posts (Atom)
Show HN: Anti-Cluely – Detect virtual devices and cheating tools on exam systems https://ift.tt/onuTQWR
Show HN: Anti-Cluely – Detect virtual devices and cheating tools on exam systems Anti-Cluely is a lightweight tool designed to detect common...
-
Show HN: An AI logo generator that can also generate SVG logos Hey everyone, I've spent the past 2 weeks building an AI logo generator, ...
-
Show HN: Snap Scope – Visualize Lens Focal Length Distribution from EXIF Data https://ift.tt/yrqHZtDShow HN: Snap Scope – Visualize Lens Focal Length Distribution from EXIF Data Hey HN, I built this tool because I wanted to understand which...
-
Show HN: Federated IndieAuth Server implemented as a notebook https://ift.tt/32IC633 April 27, 2021 at 04:37PM