Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)Y

ylai

@ ylai @lemmy.ml

Posts
129
Comments
26
Joined
2 yr. ago

  • Schenker shows off a Linux laptop prototype with Snapdragon X Elite at Computex 2024

    Jump

  • Likely due to being a prototype. Production laptops from Tuxedo tend to have the “TUX” penguin in a circle logo on the Super key by default. They also have been offering custom engraved keyboard (even with the entire keyboard engraved from scratch to the customer’s specifications) as added service, so probably there will be suppliers or production facility to change the Super key.

    By the way, there was one YouTube channel that ended up ordering a laptop with Windings engraving from them: https://youtu.be/nidnvlt6lzw?t=186

  • A new AMD vs Nvidia decision?

    Jump

  • Open Source Initiative tries to define Open Source AI

    Jump

  • How does this analogy work at all? LoRA is chosen by the modifier to be low ranked to accommodate some desktop/workstation memory constraint, not because the other weights are “very hard” to modify if you happens to have the necessary compute and I/O. The development in LoRA is also largely directed by storage reduction (hence not too many layers modified) and preservation of the generalizability (since training generalizable models is hard). The Kronecker product versions, in particular, has been first developed in the context of federated learning, and not for desktop/workstation fine-tuning (also LoRA is fully capable of modifying all weights, it is rather a technique to do it in a correlated fashion to reduce the size of the gradient update). And much development of LoRA happened in the context of otherwise fully open datasets (e.g. LAION), that are just not manageable in desktop/workstation settings.

    This narrow perspective of “source” is taking away the actual usefulness of compute/training here. Datasets from e.g. LAION to Common Crawl have been available for some time, along with training code (sometimes independently reproduced) for the Imagen diffusion model or GPT. It is only when e.g. GPT-J came along that somebody invested into the compute (including how to scale it to their specific cluster) that the result became useful.

  • Open Source Initiative tries to define Open Source AI

    Jump

  • This is a very shallow analogy. Fine-tuning is rather the standard technical approach to reduce compute, even if you have access to the code and all training data. Hence there has always been a rich and established ecosystem for fine-tuning, regardless of “source.” Patching closed-source binaries is not the standard approach, since compilation is far less computational intensive than today’s large scale training.

    Java byte codes are a far fetched example. JVM does assume a specific architecture that is particular to the CPU-dominant world when it was developed, and Java byte codes cannot be trivially executed (efficiently) on a GPU or FPGA, for instance.

    And by the way, the issue of weight portability is far more relevant than the forced comparison to (simple) code can accomplish. Usually today’s large scale training code is very unique to a particular cluster (or TPU, WSE), as opposed to the resulting weight. Even if you got hold of somebody’s training code, you often have to reinvent the wheel to scale it to your own particular compute hardware, interconnect, I/O pipeline, etc.. This is not commodity open source on your home PC or workstation.

  • Open Source Initiative tries to define Open Source AI

    Jump

  • The situation is somewhat different and nuanced. With weights there are tools for fine-tuning, LoRA/LoHa, PEFT, etc., which presents a different situation as with binaries for programs. You can see that despite e.g. LLaMA being “compiled”, others can significantly use it to make models that surpass the previous iteration (see e.g. recently WizardLM 2 in relation to LLaMA 2). Weights are also to a much larger degree architecturally independent than binaries (you can usually cross train/inference on GPU, Google TPU, Cerebras WSE, etc. with the same weights).

  • Open Source @lemmy.ml
    ylai @lemmy.ml

    Open Source Initiative tries to define Open Source AI

    www.theregister.com /2024/05/16/open_source_initiative_ai/
  • Linux @lemmy.ml
    ylai @lemmy.ml

    Intel's OpenVINO Now Available In openSUSE

    www.phoronix.com /news/openSUSE-Shipping-OpenVINO
  • Linux @lemmy.ml
    ylai @lemmy.ml

    Valve's Linux Graphics Engineers Begin Prepping RADV Driver For AMD RDNA4 "GFX12"

    www.phoronix.com /news/Valve-RADV-GFX12-Mesa-Prep
  • Open Source @lemmy.ml
    ylai @lemmy.ml

    Germany's Sovereign Tech Fund Now Supporting FFmpeg

    www.phoronix.com /news/Germany-STF-For-FFmpeg
  • Open Source @lemmy.ml
    ylai @lemmy.ml

    AMD Aims For AMF Decode In FFmpeg, Questioned Over Vulkan Video Commitment

    www.phoronix.com /news/AMD-AMF-FFmpeg-Better-2024
  • unix like operating system lovers @sh.itjust.works
    ylai @lemmy.ml

    First 9front release of the year is called DO NOT INSTALL

    www.theregister.com /2024/05/07/9front_do_not_install/
  • Privacy @lemmy.ml
    ylai @lemmy.ml

    End-to-end encryption may be the bane of cops, but they can't close that Pandora's Box

    www.theregister.com /2024/05/05/e2ee_police/
  • Privacy @lemmy.ml
    ylai @lemmy.ml

    Digital surveillance is omnipresent in China. Here’s how citizens are coping

    theconversation.com /digital-surveillance-is-omnipresent-in-china-heres-how-citizens-are-coping-225628
  • Steam Hardware @sopuli.xyz
    ylai @lemmy.ml

    Sailing away on the Steam Deck with OpenShift Virtualization (Part 1)

    www.opensourcerers.org /2024/04/29/sailing-away-on-the-steam-deck-with-openshift-virtualization-part-1/
  • retrocomputing @lemmy.sdf.org
    ylai @lemmy.ml

    Compiling MS-DOS 4.0 from DOS 4.0, on a PS/2!

    virtuallyfun.com /2024/04/28/compiling-ms-dos-4-0-from-dos-4-0-on-a-ps-2/
  • Open Source @lemmy.ml
    ylai @lemmy.ml

    The hyper-clouds are open source's friends

    www.theregister.com /2024/04/27/opinion_hyperscale_open_source/

  • Microsoft Just Released MS-DOS Source Code!

    Jump

  • There is even a sentence in README.md that makes it explicit:

    The source files in this repo are for historical reference and will be kept static, so please don’t send Pull Requests suggesting any modifications to the source files […]

  • I'm giving them a year until lifetime licenses start to mean nothing.

    Jump

  • GIMP is a special case. GIMP is being getting outdeveloped by Krita these days. E.g.:

    https://gitlab.gnome.org/GNOME/gimp/-/issues/9284

    Or compare with:

    https://www.phoronix.com/news/Krita-2024-GPUs-AI

    GIMP had its share of self inflicted wounds starting with a toxic mailing list that drove away people from professional VFX and surrounding FilmGimp/CinePaint. When the GIMP people subsequently took over the GEGL development from Rhythm & Hues, it took literally 15 years until it barely worked.

    Now we are past the era of simple GPU processing into diffusion models/“generative AI” and GIMP is barely keeping up with simple GPU processing (like resizing, see above).

  • VLC - App stores were a mistake

    Jump

  • FUSE Passthrough Mode Merged For Linux 6.9

    Jump

  • In the beginning, only privileged ones will be allowed to run in pass-through mode. But goal/roadmap calls for all FUSE filesystems eventually to have this near-native performance.

  • FUSE Passthrough Mode Merged For Linux 6.9

    Jump

  • Well, if you have a constructive suggestion which site to link instead regarding kernel developments, I am all ears:

    • Not sure that raw commits are readable or have sufficient context for non kernel development readers here
    • LWN, particularly timely/kernel development news there, has gone mostly paywall, and there will be (legitimate) complaint if I link articles needing a LWN subscription

  • FUSE Passthrough Mode Merged For Linux 6.9

    Jump

  • Not sure what called for this blatant personal attack. My post history speaks for itself, quite in comparison to yours. And Phoronix is well-known Linux website, and its test suite is in fact even referenced in various regression tests/patches in LKML (also not sure what/if any kind of kernel development you have done).

  • How long til Blu-rays get phased out

    Jump

  • Retention, or the lack thereof, when cold-stored.

    In term of SD or standard NAND, not even Nintendo does that. Nintendo builds Macronix XtraROM in their Game Card, which is some proprietary Flash memory with claimed 20 year cold storage retention. And they introduced the 64 GB version only after a lengthy delay, in 2020. So it seems that the (lack of) cold storage performance of standard NAND Flash is viewed by some in the industry as not ready for prime time. Macronix discussed it many years back in a DigiTimes article: https://www.digitimes.com/news/a20120713PR201.html.

    And Sony and Microsoft are both still building Blu-ray-based consoles.

  • Docker team is considering distributing Docker Desktop as a Flatpak and Snap

    Jump

  • Yes. If you mean “CLI” as for e.g. pacman install, it is a GUI (Electron) application, so I expect will install straight from e.g. KDE Discover and then run without you touching the shell.

  • Docker team is considering distributing Docker Desktop as a Flatpak and Snap

    Jump

  • Docker team is considering distributing Docker Desktop as a Flatpak and Snap

    Jump

  • There might be several misunderstandings:

    • Docker Desktop ≠ Docker Engine, and I think what you (and several in this thread) are thinking is actually Docker Engine. Docker Desktop ultimately includes a Docker Engine inside, but it does not appear you need that virtual machine (e.g. running non-Linux code). See: https://docs.docker.com/desktop/faqs/linuxfaqs/#what-is-the-difference-between-docker-desktop-for-linux-and-docker-engine
    • Docker Desktop is based on KVM, which already works with Flatpak. So this is not something new. For example, GNOME Boxes is available as Flatpak and provides a way to run KVM guests in SteamOS.
    • Starting with version 3.5 (the current stable) SteamOS already includes Podman with the default installation. And running the daemon-y Docker Engine “bare metal” is not going to be any easier with the immutable filesystem. While Docker Desktop solves this by using KVM, it adds another layer with performance loss, vs. just running Podman containers.

    So what you want is already available, and no Docker Desktop is actually needed.

  • How does she know...

    Jump

  • AMD’s support for AI is just fine

    This is quite untrue, especially if you do actual research and not just run other people’s models. For example, ROCm is missing in many sparse autograd frameworks, e.g. pytorch_sparse, or having a viable alternative to Nvidias MinkowskiEngine. This is needed if you do any state-of-the-art convnets with attention-like sparsity.

  • Intel Begins Sorting Out SR-IOV Support For The Xe Kernel Graphics Driver

    Jump

  • Yes. But one should also note that only a limited range of Intel GPU support SR-IOV.

  • Joint Statement by Free Software Foundation Europe and Software Freedom Conservancy Regarding Eben Moglen and Software Freedom Law Center

    Jump
  • Removed Deleted

    Permanently Deleted

    Jump

  • You know, there are several built-in functions in phones, that are already viable methods to communicate remotely?