Two interesting models. Karen (amazing name!) is a strict language and grammar editor and is amazing and fast. See attached picture with my firing test. The second one is for generating questions from a text. Both use Mistral-7B as the base model.… Juraj Nov 21, 2023, 10:29 AM
Trezor has black friday sale, good present for Christmas. Especially Trezor Model One for $48 looks great, no excuse to not hold your private keys in your HW wallet anymore. They also have sale on bundles and Trezor T, but I think cheap entry level wallet is key.… Juraj Nov 21, 2023, 4:06 AM
Has anyone had success finetuning an already fine tuned model such as Synthia-13B or any other model. Lora or Qlora with llama.cpp or Axolotl? I have very mediocre results. Dataset is 1700 examples, prompts formatted correctly. It hallucinates and does not retain much, if it works at all… Juraj Nov 21, 2023, 2:55 AM
From Balajis on X: NO DECENTRALIZATION WITHOUT POLARIZATION Haseeb is right. But this is good. Because before the events of the last few days, we had only one dominant view — and it resulted in executive orders, compute bans, and well-funded coalitions for “responsible AI.” But all can now see… Juraj Nov 20, 2023, 11:52 PM
I wrote a short book called "Cypherpunk visions and trends 2023-2025" in January. I called for open source AI. The fact that a cypherpunk wants open source AI is not particularly interesting, what is interesting is, that the values of Cypherpunks start to align with wider societal Juraj Nov 20, 2023, 5:57 AM