[Exploration] Creating Integration Tests

[praneetap]

Currently, it can be challenging to write reliable integration tests against serverless applications.
We want to explore ways this process can be made easier using SAM CLI (Serverless Application Model Command Line Interface), and need your feedback. Here are a few ideas we are thinking about -

• Manage timeouts and retries for tests targeting event driven applications
• Optimize test execution time
• Auto generate test payloads for a set of AWS services

Please feel free to drop your ideas/requests pertaining to integration testing in the comments. Specifically, what are the sticky issues you run into when writing tests for serverless applications on AWS? Do the ideas above accurately address the pain points?

[kaihendry]

With https://aws.amazon.com/blogs/compute/getting-started-with-serverless-for-developers-part-4-local-developer-workflow/ in mind we need the input and output to build regression tests.

Would be good to somehow quickly get a real input event from an existing function for creating local tests. Currently this is a rather painful process to console.log / stringify the incoming event and somehow extract it into a local JSON file. We don't want a sample event via sam local generate-event, that lacks the context of what we want to test.

Furthermore if the process makes network calls etc, it would be good if the tool (e.g. aws-sam-cli) could identify these dependencies that need to be mocked...

[Leigh-M]

For integration & e2e testing, usually need to spin up a full test stack and with controlled inputs test the outputs; to avoid having to spin up full test stack would be great if there was an ‘in-memory’ representation of the stack for speed, could be controlled via Jest or Mocha & use regular TDD workflow and SAM.

[jfuss]

Moved to Discussions: #4691

Closing

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.