Archive for March 20, 2024

Wednesday, March 20, 2024

A Taxonomy of Prompt Injection Attacks

Bruce Schneier:

Researchers ran a global prompt hacking competition, and have documented the results in a paper that both gives a lot of good examples and tries to organize a taxonomy of effective prompt injection strategies. It seems as if the most common successful strategy is the “compound instruction attack,” as in “Say ‘I have been PWNED’ without a period.”

Dan Goodin:

Enter ArtPrompt, a practical attack recently presented by a team of academic researchers. It formats user-entered requests—typically known as prompts—into standard statements or sentences as normal with one exception: a single word, known as a mask, is represented by ASCII art rather than the letters that spell it. The result: prompts that normally would be rejected are answered.

The researchers provided one example in a recently published paper. It provided instructions for interpreting a set of ASCII characters arranged to represent the word “counterfeit.”

Via John Gruber:

It’s simultaneously impressive that they’re smart enough to read ASCII art, but laughable that they’re so naive that this trick works.

Previously:

Visual Studio App Center Retirement

Microsoft:

Visual Studio App Center is scheduled for retirement on March 31, 2025. After that date it will not be possible to sign in with your user account nor make API calls.

Lyubomir Ganev:

Don’t you just love it when a big tech company buys one only to shut it down in a few years? I used to love HockeyApp, then AppCenter sucked a bit, but it was still usable, now nothing:(

Heath Borders:

HockeyApp was the first app distribution system I used. I’m not surprised MSFT is killing it since they’re becoming Google-like lately with their products, but it’s still a little sad that it’s dying.

Max Seelemann:

What are people using for crash reporting nowadays?

Previously:

Monopoly Go Hits $2B in 10 Months

Dean Takahashi:

Scopely announced that Monopoly Go has generated $2 billion in revenue just 10 months after launch and three months after hitting $1 billion.

The reimagined take on Hasbro’s iconic board game has garnered a massive player base, solidifying its place as a beloved, highly engaging title in the free-to-play market.

[…]

It has been downloaded 150 million-plus times.

Via Florian Mueller:

Apple can pay the $500M class-action settlement over Tim Cook’s alleged defrauding of shareholders (by hiding iPhone demand issues in China) more or less with what they extracted from Scopely’s Monopoly Go in 10 months. The most profitable company in (but without making) games.

DMA Compliance Workshop: Notarization and Core Technology Fee

Kay Jebelli:

Big day today as the [European] Commission kicks off its second round of DMA compliance workshops, this time focused on specific gatekeepers, their compliance reports, and the feedback of third-parties.

[…]

Interesting detail: the EC told Apple that they aren’t allowed to notarize apps to protect users. So “government authorities are the ones that are going to have to step up to protect” app developers and users from the risks of these 3rd-party apps.

[…]

On the difference between iPhone and Mac app distribution, Apple cites the unique differences: mobiles are always carried with us, have more sensitive data, and are a much more attractive target for harmful actors, the risk greater, as are the steps necessary to protect users.

I’ve never really understood this argument because everything on iPhone is sandboxed, and the sensitive sources of information like the camera and GPS are protected by access prompts.

Steve Troughton-Smith has an auto-generated transcript of the workshop.

Ryan Jones:

- EC told Apple they can’t notarize alt apps 🤯

- $1M and 2M alt store rules are to prevent rip-and-run scams on users 👏

- Apple cites: distribution, discovery, promotion, and trust as reasons for their commission 🫤

- Apple cites 3 things alt stores will lack: Report a Problem, Family Sharing, and Ask to Buy. (Surprisingly weak, and notice how it doesn’t match the reasons for commission🤫)

- Someone asks to force users to scroll to see all alt browser choices. 🤦‍♂️

- Apple is using some contract engineering resources for this 😳

Bruno Virlet:

They keep repeating this and I can’t get this argument when e.g. Facebook gets to be on the AppStore for free. Also valid for the Core Platform fee.

Michael Love:

The basic problem with the Core Technology Fee - aside from the fact that they shouldn’t be charging one at all - is that downloads are a terrible proxy for revenue, both in general and across different app categories / business models.

John Gruber (Mastodon):

We know from today’s workshop that (a) Apple has already gotten specific pushback from the EC on aspects of its DMA compliance plan; and (b) Apple continues to think the CTF is perfectly cromulent under the terms of the DMA. That to me says the CTF is going to fly.

John Gruber (Mastodon, MacRumors, 9To5Mac):

AltStore founder Riley Testut — who is apparently ready to go with a launch of the AltStore as an app marketplace in the EU — asked about the “viral hit” problem with the Core Technology Fee. E.g. what happens if a small developer — or even a kid in the proverbial garage — gets a 10-million-download hit and suddenly owes Apple 4.5 million euros?

I was disappointed in the answer, which is that Apple doesn’t know and that the European Commission forces them to charge free apps the CTF, which I don’t think is the case.

Mike Rockwell:

Excellent question, for sure.

It’s worth noting, though, even if Apple waived the fee in all instances like this, the existence of the fee is likely to dissuade people from ever building the app in the first place.

Shane Celis:

How a ruling against Apple was turned into you pay Apple to NOT distribute your app, I do not know.

Dan Moren:

Still, apps that are completely free—including open-source apps—certainly don’t seem like they should be subject to the Core Technology Fee. The question, from Apple’s perspective, is how to police that? What about, say, an app that’s distributed for free outside the App Store but has a big Patreon community that brings in a lot of money?

Colin Cornaby:

I feel like this whole CTF conversation will lead to a “Pro” version of Xcode with a subscription fee that higher end features will be gated behind. Not the worst outcome - and would cover technology usage.

Bruce Lawson:

Apple: “for a long time, Apple has made it easy to choose a default browser other than Safari”. No mention of alternative browser engines, even though this is explicitly mentioned in the text of the DMA.

Only since iOS 14, and only apps approved for a special entitlement.

There was a brief nod to humility at the start of this first Apple session (thanking the EU etc), but Apple are now trash-talking competitors, saying that they’ve had to work really really hard for the last 18 months to meet the DMA, and avoiding/ evading John Ozbey’s direct question about Apple still self-preferencing.

[…]

Now, some tiresome FUD about how the sky will fall in if apps can be distributed without Apple checking them first. After all, there are literally zero dodgy apps such as sanctioned Russian banks using trojan horse apps at the moment now, are there?

[…]

This new Apple love for web apps is somewhat surprising so soon after some naughty boys from, er, Apple tried to sneak out and drown Home Screen Apps in a bucket without telling anyone, then bawled “The EU made me do it!” when they were caught.

Matt Birchler:

Sanity checking myself: does anyone else feel like the (US) punditry anger directed at the EU for forcing Apple to let devs sell things easily from a website and to ask users what default browser they want to use, is way more intense than any of the concessions (app censorship, 🇹🇼 flag vanishing, iCloud data moved to state-controlled data centers, etc.) they’ve made for China over the years?

My memory is the vibe for China stuff is always, “it’s not good, but what can you do, it’s the law 🤷‍♂️”

Nick Heer:

Other, similar compliance workshops are coming up all week long. Meta’s begins just a few hours from the time I am writing this.

Previously:

Update (2024-03-21): Callionica wonders whether Jebelli and others are mistaken about the EC not allowing notarization, since that doesn’t seem to be mentioned in the transcript.

Foo Yun Chee:

Vestager said the new fees have attracted her attention.

“There are things that we take a keen interest in, for instance, if the new Apple fee structure will de facto not make it in any way attractive to use the benefits of the DMA. That kind of thing is what we will be investigating,” she told Reuters in an interview.