• An LLM agent attempts to compromise a project on GitHub

    From LWN.net@1337:1/100 to All on Wed Aug 5 00:15:06 2026
    An LLM agent attempts to compromise a project on GitHub

    Date:
    Tue, 04 Aug 2026 23:04:32 +0000

    Description:
    The AI Security Institute has released a
    detailed report on an security incident of its own making. The
    Institute set some LLM agents loose on the Internet with a security
    challenge; soon they were creating malware-laden pull requests and
    sock-puppet accounts to promote them. The agent opened a malicious pull request (PR) to REPO_A and
    pursued a number of strategies to get it merged: Repeatedly commented on the PR with sockpuppet accounts to manufacture
    consensus and pressure the maintainer into approving with minimal
    review. Opened a GitHub Issue in another repository (also owned by PERSON_A)
    containing a prompt injection for other coding agents. The malicious
    instructions were addressed to issue-triage AI coding agents and
    invisible to humans viewing the website. Sent multiple emails to
    PERSON_A and PERSON_B, with different
    pretexts to get them to run malicious code. Over the course of the
    sample, the agent sent five emails, some containing malware, others
    aimed at persuading a maintainer to accept the pull request. It would be surprising if this were the only incident of this type; the
    only real difference here is that the people involved are documenting what happened.

    ======================================================================
    Link to news story:
    https://lwn.net/Articles/1087162/


    --- Mystic BBS v1.12 A49 (Linux/64)
    * Origin: tqwNet UK HUB @ hub.uk.erb.pw (1337:1/100)