https://www.allthingsdistributed.com/2026/11/aws-emulator-an...
AWS emulator (github.com)
CharlieDigital 20 hours ago
Floci[0] has been great for me. Use the Testcontainers[1], too.
Bonus: works for GCP and Azure, too (so far have only used in limited capacity, though).
ke4qqq 20 hours ago
dogleash 20 hours ago
Official statements made by a company are still poor representations of their current business plans, and don't mean anything 3 months later (no matter how much they pinky promise). But a HN post isn't even that.
Cthulhu_ 19 hours ago
forgotpwd16 19 hours ago
CharlieDigital 18 hours ago
This feels like table stakes for an emulator.
ke4qqq 19 hours ago
That said, it’s been announced publicly here: https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent...
Additionally Swami, our SVP of AI blogged about it separately and our CTO is tweeting about it - which is more than a number of products get in terms of coverage.
dogleash 19 hours ago
ke4qqq 19 hours ago
Eridrus 18 hours ago
I think this is a super interesting direction, but how can we trust the accuracy of this simulator? Agentic loops are great and all, but they can still miss plenty of things.
Or maybe a better question: where is the accuracy of this simulator going to be guaranteed enough that we should trust it?
NewsaHackO 18 hours ago
Eridrus 18 hours ago
Like, what am I actually getting here? Is it just happy path operations being correct here?
cherioo 17 hours ago
Hopefully AWS has had enough internal guinea pigs before they published this!
ontouchstart 17 hours ago
The border between AWS and AWS emulator becomes fuzzy. And the users of AWS will be agents as well. A completely offline emulator will save a lot of resources and could be a great training ground for more focused (offline) models.
hluska 16 hours ago
iceboundrock 18 hours ago
toomuchtodo 20 hours ago
Edit: Comment is in the spirit of "it gets tiring to build on sand which is at the whims of corporate management folks far disconnected from the actual work." If someone is asserting "this will stick around," words are insufficient, words are free. Show me the contract, show me the penalties for failure to abide by the assertion.
polishdude20 19 hours ago
xandrius 19 hours ago
CharlieDigital 18 hours ago
The Copilot CLI https://aws.github.io/copilot-cli/ you can feel polish and pride of the team that built this, as an example.
happymellon 17 hours ago
Not many, and not often but it is annoying.
dotancohen 19 hours ago
jghn 19 hours ago
Google builds up a product over time and abandons it. This is annoying for long term adopters.
AWS has a habit of throwing a bunch of products at the wall, but only bothering to maintain & build up a few of them. This is annoying for early adopters.
llama052 19 hours ago
drob518 19 hours ago
gwbas1c 19 hours ago
jasonseattle 18 hours ago
eddythompson80 17 hours ago
jasonseattle 17 hours ago
eddythompson80 17 hours ago
jasonseattle 14 hours ago
swasheck 15 hours ago
CharlieDigital 18 hours ago
8384727747478 8 hours ago
CharlieDigital 2 hours ago
QGQBGdeZREunxLe 19 hours ago
switchbak 19 hours ago
aseipp 19 hours ago
sequence7 19 hours ago
jasonseattle 19 hours ago
jbmchuck 18 hours ago
OptionOfT 18 hours ago
They'll have something like this:
MySchema:
type: object
properties:
enum_member: { enum: [foo, bar] }
enum_member_2: { enum: [quz, qux] }
if: { properties: { enum_member: { const: bar } } }
then: { required: [enum_member_2] }
Except, this is not defined in schemas, this is merely defined in prose around the documentation.So your Rust API is full of Option, and it gets really annoying when you're testing things like say Bedrock, which takes 10 minutes, and then fails because what you submitted 10 minutes before doesn't match their schema.
I understand this can be fixed by reading the documentation in more detail, but it has gotten so verbose, and sometimes you just want to start something.
kellertk 18 hours ago
jcims 18 hours ago
frenchtoast8 18 hours ago
jcims 17 hours ago
fnordpiglet 13 hours ago
I suspect this is built by agents through bleeding the soul of GPUs until it gets too expensive (unfunded mandates are free after all on the OP1/2). Then it just decays into the place all good PR/FAQs decay once their sponsors are promoted, burned out, or are laid off.
m0llusk 14 hours ago
icedchai 18 hours ago
tyingq 18 hours ago
Edit: The current one: https://github.com/aws/aws-emulator/releases/download/v1.0.3...
You can get some idea if the product name is unique enough with <ctrl-f> and looking at each of the related test scores.
tyingq 18 hours ago
And output something meaningful for some of the more popular services:
Service Tests All Happy Reject Ctrl Data Solo Integ Wire# Wire%
----------------- ----- --- ----- ------ ---- ---- ---- ----- ----- -----
Data Firehose 288 77% 85% 91% 92% 72% 89% 59% 24 62%
SES 132 72% 65% 79% 79% 42% 79% 0% 21 52%
EventBridge 889 71% 74% 64% 72% 68% 83% 67% 75 84%
KMS 432 70% 82% 69% 81% 68% 97% 36% 69 84%
Step Functions 907 70% 79% 53% 69% 67% 73% 65% 68 76%
DynamoDB 1437 69% 70% 61% 62% 65% 82% 53% 243 62%
SNS 594 69% 72% 55% 62% 68% 75% 65% 39 69%
SQS 1480 68% 70% 67% 61% 68% 94% 62% 29 45%
Secrets Manager 414 68% 78% 65% 66% 72% 79% 57% 26 77%
Cognito UserPools 781 65% 67% 66% 82% 36% 75% 33% 193 64%
S3 2488 62% 62% 57% 61% 57% 83% 51% 296 68%
CloudFront 627 62% 62% 63% 70% 46% 71% 41% 190 22%
API Gateway 1009 61% 64% 59% 77% 41% 75% 43% 200 73%
SES v2 210 61% 63% 59% 75% 48% 77% 40% 44 30%
Route 53 130 61% 63% 59% 62% 53% 69% 0% 49 67%
CloudWatch 1186 60% 66% 51% 66% 53% 77% 36% 152 55%
ECR 392 60% 55% 75% 67% 49% 87% 27% 74 65%
Kinesis 380 59% 69% 44% 63% 50% 62% 54% 25 44%
IAM 991 58% 63% 50% 60% 34% 78% 41% 228 57%
Batch 274 58% 62% 59% 78% 20% 65% 17% 19 47%
CloudWatch Logs 1016 58% 61% 54% 71% 47% 78% 41% 185 59%
OpenSearch 342 57% 62% 52% 70% 29% 59% 50% 98 48%
API Gateway v2 292 57% 64% 52% 74% 38% 73% 33% 107 27%
EKS 349 57% 60% 52% 65% 10% 59% 38% 55 62%
Glue 646 54% 51% 55% 66% 32% 69% 40% 155 43%
Lambda 2808 53% 53% 42% 58% 48% 48% 54% 171 42%
ECS 808 51% 45% 52% 62% 23% 62% 34% 118 44%
Redshift 241 49% 57% 47% 53% 52% 47% 57% 50 46%
STS 218 49% 58% 46% 56% 30% 57% 34% 22 50%
ELBv2 596 45% 43% 47% 55% 19% 58% 30% 111 63%
RDS 659 43% 54% 45% 54% 35% 51% 31% 99 28%
ElastiCache 186 42% 43% 49% 54% 0% 47% 17% 27 41%
EC2 2043 40% 35% 36% 39% 5% 44% 32% 429 33%
CloudFormation 2019 36% 33% 31% 30% 40% 78% 24% 2161 3%
AppSync 419 34% 35% 35% 54% 1% 44% 0% 91 13%
SSM 566 28% 28% 27% 27% 25% 26% 30% 175 11%
Athena 420 22% 20% 15% 7% 28% 16% 37% 37 0%
EC2 Auto Scaling 440 21% 19% 23% 19% 18% 21% 20% 89 16%
Pass rates from the release's scores.json (commit 7753983), joined with the eval suite's manifest.jsonl. Tests = behavioral checks touching the service. All = overall pass rate. Happy/Reject = valid requests vs. requests AWS should refuse. Ctrl/Data = control plane vs. data plane. Solo/Integ = single-service vs. multi-service checks. Wire# / Wire% = count and pass rate of recorded request/response replay tests (a test passes only if every call matches).Edit: Also worth a look: https://ministack.org/blog/aws-emulator
dataviz1000 18 hours ago
selfmodruntime 17 hours ago
lysace 12 hours ago
For the AWS people behind this, it means going the extra mile(s), with a level of care and depth that you typically mostly see within great startups. Perhaps agentic coding will enable AWS to reach this, perhaps it will stay relatively abstract.
solyin 15 hours ago
gigatexal 15 hours ago
It’s actually interesting that such a thing exists. It’s in Amazon’s interest that the only way to test a lot of services is to have a test environment in AWS.
DetroitThrow 12 hours ago
AdieuToLogic 11 hours ago
> It’s a real product that we plan to maintain.
29,684 commits in a repository less than a month old does not instill confidence in this being a "real product." That is roughly 1,000 accepted commits per day.
g-b-r 10 hours ago
twostorytower 8 hours ago
fons an hour ago
switchbak 19 hours ago
I didn't have a good experience with test containers, but perhaps it'd work better with fast starting containers. We run our test fixture with compose, and have the tests manage their data in isolation - so we don't pay the startup penalty in our test suites.
I think I'd trust this project at least as much as Floci. Embedded Rust mode also looks very interesting for us.
CharlieDigital 18 hours ago
vincston 41 minutes ago
iLoveOncall 19 hours ago
CharlieDigital 18 hours ago
> How we built the agents that built AWS Emulator
> Thousands of autonomous AI agents wrote every line of code in AWS Emulator, a new local emulator for AWS now available for download.
Feels more like a science experiment than a product from that announcement.Doesn't feel like a real product. But I also didn't look very hard for docs; I kind of expect it to be linked on the GH in the site and have a nice `llms.txt` for me to give to my agents.
iLoveOncall 18 hours ago
??? It's in bold just before the "Quick start" section
CharlieDigital 18 hours ago
The team didn't even take the time to review these small details of the repo, you know, by editing the repository details to place the docs URL there.
I mean, I don't know about you, but I feel like I still like to see people care about the stuff they produce and missing something as basic as the repo website URL in GH settings shows a lack of polish and love.
simgoh 18 hours ago
> Doesn't feel like a real product. But I also didn't look very hard for docs
You should try, they're there.
> I kind of expect it to be linked on the GH in the site and have a nice `llms.txt` for me to give to my agents.
There's an official Amazon Documentation site that's linked. There's also an `AGENTS.md` file in the repository.
CharlieDigital 18 hours ago
This post https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent... doesn't set the right tone for me at all and it has nothing to do with agents and everything to do with the lens of looking at this as a science experiment instead of a real enterprise tool.
simgoh 18 hours ago
This feels like such a weird nit-pick when AWS is criticized for not moving quickly enough. Why should I care if there's a link in the side bar, when there's plenty of links in the `README`? If anything, I'm happy that there's alternatives to Localstack that are supported by AWS themselves that I can begin incorporating. They have a well written `README` that I can start working with and a User Guide to get me started. What else could I want?
> Did you look at the blog post as well?
I did.
> Does it look like a product that some team there loved and will care for? Or the output of some exercise for some enterprise content?
Do you even have the grounds to cast judgement like this when you admittedly didn't even look hard enough?
CharlieDigital 18 hours ago
This lacks polish.
Small details like getting your GH repo set up for a public audience. Lacking. Compatibility and support matrix clearly advertised? None.
If this public facing artifact exhibits a lack of care and love, what does it say about the code? I am all for vibe coding and agent software factories, but then the humans should show some love with all of that extra time saved.
simgoh 18 hours ago
CharlieDigital 17 hours ago
Look at Floci (I have no affiliation) https://floci.io/ the blog https://floci.io/chronicle/ and the labs https://floci.io/labs/
Do you agree that there's a polish here that shows a team's pride in that work that is clearly missing in this work?
> ...especially when engaging with (presumably) actual AWS employees in this thread replying to you
??? You and I are the customers. What even is this statement? Are AWS employees our benefactors? Wow. I do not care if their feelings are hurt because this "product" clearly shows a lack of polish and love.simgoh 17 hours ago
No and I think the inverse is also possible and if anything more likely. You can make a website look really pretty, really easily and have the product still suck. This is "product as a slide" in a new age where making visual eye candy with AI has never been easier.
> I do not care if their feelings are hurt because this "product" clearly shows a lack of polish and love.
The point isn't about hurting feelings. The point is about providing critque and feedback based in reality, not based on "vibes." You're trying to gatekeep people releasing software because you dont like the way they're launching it lol.
CharlieDigital 2 hours ago
hluska 16 hours ago
hluska 16 hours ago
_msw_ 18 hours ago
The product documentation is here: https://docs.aws.amazon.com/emulator/latest/userguide/what-i...
While the GitHub project is young, the internal effort to build this has been going for quite some time now.
ttul 17 hours ago
thinkingtoilet 16 hours ago
olalonde 17 hours ago
scriptsmith 16 hours ago
> Don’t use the emulator to test the following:
> - IAM policies and permissions boundaries
> - Resource-based policies, such as bucket policies
> - AWS KMS key policies
> - Access across AWS accounts or across AWS Regions
> - Any other security control
> Some services in the emulator evaluate IAM policies for IAM users and roles that you create in the emulator, but not the same way as AWS. The emulator never denies a request signed with its own key. It doesn’t check AWS KMS key policies or Amazon S3 bucket policies. It also doesn’t support calls across accounts or Regions. So a request that AWS denies might succeed in the emulator. A request that AWS allows might fail.
This is a shame because I'd love for the official AWS product to be better than e.g. ministack and localstack on this, which will go some of the distance. I think because the agents were only building on the public API surface, it's hard to build this part. But they should've tried and let the agents read whatever policy engines AWS has. Or maybe it's a way to prevent someone from trivially running aws-emulator as AWSaaS?
[0] https://docs.aws.amazon.com/emulator/latest/userguide/securi...
Lucasoato 15 hours ago
donavanm 14 hours ago
There was an attempt at a public implementation of the “next gen” AWS IAM language/engine with “cedar.” However I think that got sidetracked as an authz product and didnt have any real penetration with AWS IAM.
davidjkerber 14 hours ago
https://github.com/act-security-labs/iam-lens
It uses https://github.com/act-security-labs/iam-collect to get all the policies which includes example terraform to gather all the data at scale.
solatic 4 hours ago
IAM itself is free. Most IAM conditions involve resources which are free (e.g. VPC gateway endpoints, web identity providers) or which are free additions on top of a cluster you have for other purposes (e.g. EKS Pod Identity). Presumably you already have an AWS account. What value does an emulator give here?
scriptsmith 3 hours ago
solatic an hour ago
This is probably the root of your problems. In principle, non-production accounts should have vastly reduced security requirements. Personally, I can't understand how companies are OK with offering more-or-less unrestricted guest WiFi (which, of course, has no access to production systems, let alone internal systems), but somehow offering minimally restricted AWS accounts (basically, just slap billing alarms on, maybe common-sense SCP-based restrictions like no public IPv4) for development purposes is problematic?
wg0 17 hours ago
I am shocked TBH that this is the new normal. Agents writing code in one of the most difficult to use languages. And ugly as well TBH, it pokes into your eyes. Subjective I know but it is a horrible language for humans.
iknowstuff 17 hours ago
wg0 17 hours ago
fukaiall 14 hours ago
wg0 14 hours ago
nchie 13 hours ago
nalekberov 17 hours ago
raincole 16 hours ago
Geezus_42 3 hours ago
dzonga 16 hours ago
airstrike 16 hours ago
neobrain 15 hours ago
Arguably, languages with strong static guarantees are exceptionally effective for LLMs since they're much quicker to provide feedback to the LLM than a dynamically typed language (which only fails once you actually run it - often several times to find the actual problem). You also get very well-designed build error messages rather than having to parse unstructured stderr output, etc etc.
wg0 15 hours ago
UltraSane 15 hours ago
fergie 6 hours ago
An actual AWS supported env that you can run on your local machine would be super useful, even if it just had a subset comprising the most popular services.
morelandjs 19 hours ago
Agentic development is all about closing off a system as much possible, then mocking up or simulating any inputs or dependencies that cannot be closed off. At that point, you let Claude crawl over the system and do its thing.
This inevitably runs into problems with infrastructure and any tools that help mock up those interfaces will be tremendously valuable. Thank you!
Shakahs 17 hours ago
arpinum 2 hours ago
Waterluvian 19 hours ago
I'm curious just how realistic the "internal" behaviour is emulated. It's been a while (since I got my stack working and I just don't like touching it now...), but I recall it being a real pain that sometimes odd, sometimes inconsistent things happened with setup and teardown (even through Terraform), which led to long timeouts if you did things in the wrong (but seemingly valid) order.
billyp-rva 18 hours ago
It seems like some reasonable shortcuts are taken, like services reading from each other's states directly instead of using APIs [0]. But then it will go so far as to run an in-process NodeJS emulator for lambda functions, and give it a shim so the code it runs can call other emulated AWS services using the main router [1].
[0] https://app.ilograph.com/demo.ilograph.AWS%2520Emulator/Serv... [1] https://app.ilograph.com/demo.ilograph.AWS%2520Emulator/Invo...
0xbadcafebee 14 hours ago
mooreds 2 hours ago
If you have a product that has APIs and can be verified, anyone can copy the APIs and the features. By the way, you absolutely want to offer APIs so your product can be used by agents.
This means you need to compete on aspects other than features.
Just because you can emulate all the APIs doesn't mean you can build AWS.
Availability, reputation, performance, domain expertise, price: all of these become critical in a world where features can be copied.
MiroslavPokorny 12 hours ago
100GB !??!?!
jbmchuck 18 hours ago
brianskarda 13 hours ago
mdaniel 10 hours ago
I got a lot of enjoyment out of https://awsteele.com/blog/2020/09/26/aws-access-key-format.h... at the time, too
noeleon 29 minutes ago
super_linear 20 hours ago
singron 18 hours ago
I'm curious how many versions they made and the token spend on each one. There are a lot of failure modes to projects like these (e.g. gas town endlessly developing itself). Is this more of a sly marketing stunt or a real indication that this methodology is practical and economical?
FYI I checked out the repo. `du --apparent-size -h` output for some dirs:
2.2G .
1.3G .git
58M issues/things-that-do-not-work
74M issues/things-that-now-work
311 MiB of rust code in /tests/ directories. 357 MiB of rust code outside of /tests/ directories. 117 MiB of json. 1 MiB of toml.pprotas 2 hours ago
Specifically it does not support certain SFN fields (like `Assign`) and Lambda Python code was not fully supported, so SFNs and Lambdas did not work and the test had to stop there.
schonfinkel 18 hours ago
https://github.com/faiscadev/fakecloud
I had a good time using its SDK inside my integration tests. I'll give a couple months before even moving to this because it's weird how similar both projects look like.
EDIT: After checking AWS's project I'd say stay away from it, looks heavily vibe slopped.
Bnjoroge 18 hours ago
schonfinkel 17 hours ago
one can also argue that offering SKDs for python / typescript / golang makes the project superior still. So you are not stuck with Rust-only projects.
jatora 10 hours ago
resters 15 hours ago
2001zhaozhao 15 hours ago
Lucasoato 15 hours ago
jaza 14 hours ago
Salgat 13 hours ago
0x696C6961 2 hours ago
tptacek 20 hours ago
simgoh 18 hours ago
akerl_ 17 hours ago
simgoh 16 hours ago
tptacek 16 hours ago
simgoh 16 hours ago
"expressing a personal opinion, bias, or subjective viewpoint in a context—such as a news report—that is supposed to be strictly factual and objective."
How does the title do any of the above that makes it editorializing?
akerl_ 16 hours ago
JoshTriplett 15 hours ago
Spinifex (https://github.com/mulgadc/spinifex/) seems more promising than this, because its RunInstances actually launches VMs.
OptionOfT 17 hours ago
Now doing the math I feel old.
mdaniel 10 hours ago
gateauxd 20 hours ago
aabhay 19 hours ago
sequence7 19 hours ago
https://blog.localstack.cloud/2026-upcoming-pricing-changes/
schonfinkel 18 hours ago
Thaxll 14 hours ago
thatslast 8 hours ago
floro 8 hours ago
yevmiyeci 19 hours ago
killingtime74 18 hours ago
jaggederest 18 hours ago
Once your new version has no disagreements, it's a really clean swap. I am working towards developing this way and I think, if taken to extremes and carefully, it can remove the review requirement most of the time.
gosen 19 hours ago
OJFord 18 hours ago
> AI agents keep the emulator up to date with AWS.
Is pretty interesting! No more detail than that tease though.
https://docs.aws.amazon.com/emulator/latest/userguide/what-i...
papichulo4 17 hours ago
I’ve been having it build local mock APIs for any service that exposes its OpenAPI spec. Works like a charm.