Investigate and fix race conditions about terraform-exec HOT 8 CLOSED

Thanks for opening this, @radeksimko. Is this causing problems in the LS?

from terraform-exec.

@kmoe I'm not aware of it causing problems to the users, at least nobody filed an issue. I was able to reproduce it in one test in LS though.

I assume that the reason it's (probably) not affecting users is because they'd have to be running many commands at the same time - which some of them probably do, but we limited that significantly per hashicorp/terraform-ls#391 - and the execution would need to overlap in a particular (split-second) moment.

I mean - race conditions are just hard to reproduce in general. 🤷🏻‍♂️

from terraform-exec.

There are valid terraform-exec use cases involving parallel execution outside the LS, so this is the highest priority bugfix for tfexec right now, but active LS issues would raise it to "critical".

There shouldn't be any other test failures with 0.12.0, or rather, 0.12.30 (a support policy we should be clearer about). Filing and fixing these will be done as part of investigating the race failures.

from terraform-exec.

There shouldn't be any other test failures with 0.12.0, or rather, 0.12.30

As far as I can remember these were related to some of the CLI flag changes (in master/main), so I think that is expected as these tests rely on an external source, which itself is a moving target.

I'm not sure how/whether that affects the support policy. I assume we intend to support all versions of Terraform (on best-effort basis), but do we also intend to offer such support in all versions of terraform-exec? That seems like a promise hard to uphold.

from terraform-exec.

Just ran into another race condition in some LS tests:

https://github.com/hashicorp/terraform-ls/pull/448/checks?check_run_id=2225193121#step:10:31

The trace suggests it's a different one, but I haven't looked into it too deeply.

from terraform-exec.

Actually this one is pretty much 100% (3 out of 3 attempts) reproducible with go test -race (on LS side at least) ^ which means it's likely to be attributed to some of the recent dependency updates. 👀

from terraform-exec.

The last mentioned race condition will is fixed in go-getter 1.5.3 via hashicorp/go-getter#315 but the other race conditions are AFAIK still present and likely unrelated.

from terraform-exec.

This was addressed by the amazing @lornasong in #299 🎉

go test ./... -race -count=5 -timeout=30m
?   	github.com/hashicorp/terraform-exec/internal/version	[no test files]
ok  	github.com/hashicorp/terraform-exec/tfexec	17.355s
ok  	github.com/hashicorp/terraform-exec/tfexec/internal/e2etest	907.986s
?   	github.com/hashicorp/terraform-exec/tfexec/internal/testutil	[no test files]

from terraform-exec.