Problem with installing apps from marketplace

Description:

API says meet jitsi app is installed, but it does not appear as installed all the time.

Steps to reproduce:

1. Go to Administration -> Apps
2. Find jitsi app
3. Click on install

Expected behavior:

App is installed.

Actual behavior:

API responds that app is not installed

https://user-images.githubusercontent.com/1408564/181066591-39981033-cbf6-4a72-abbd-f7ab59a4d85a.mp4

Server Setup Information:

• Version of Rocket.Chat Server: 5.0.0
• Operating System: Ubuntu
• Deployment Method: k3s
• Number of Running Instances: 2
• DB Replicaset Oplog: enabled
• NodeJS Version: v14.19.3
• MongoDB Version: 5.0.9 / wiredTiger (oplog Enabled)

Client Setup Information

• Desktop App or Browser Version: firefox
• Operating System: Linux

Additional context

> rs.status()
{
	"set" : "rs0",
	"date" : ISODate("2022-07-26T16:58:22.865Z"),
	"myState" : 1,
	"term" : NumberLong(1),
	"syncSourceHost" : "",
	"syncSourceId" : -1,
	"heartbeatIntervalMillis" : NumberLong(2000),
	"majorityVoteCount" : 2,
	"writeMajorityCount" : 2,
	"votingMembersCount" : 2,
	"writableVotingMembersCount" : 2,
	"optimes" : {
		"lastCommittedOpTime" : {
			"ts" : Timestamp(1658854696, 1),
			"t" : NumberLong(1)
		},
		"lastCommittedWallTime" : ISODate("2022-07-26T16:58:16.556Z"),
		"readConcernMajorityOpTime" : {
			"ts" : Timestamp(1658854696, 1),
			"t" : NumberLong(1)
		},
		"appliedOpTime" : {
			"ts" : Timestamp(1658854696, 1),
			"t" : NumberLong(1)
		},
		"durableOpTime" : {
			"ts" : Timestamp(1658854696, 1),
			"t" : NumberLong(1)
		},
		"lastAppliedWallTime" : ISODate("2022-07-26T16:58:16.556Z"),
		"lastDurableWallTime" : ISODate("2022-07-26T16:58:16.556Z")
	},
	"lastStableRecoveryTimestamp" : Timestamp(1658854676, 1),
	"electionCandidateMetrics" : {
		"lastElectionReason" : "electionTimeout",
		"lastElectionDate" : ISODate("2022-07-14T20:14:03.622Z"),
		"electionTerm" : NumberLong(1),
		"lastCommittedOpTimeAtElection" : {
			"ts" : Timestamp(1657829643, 1),
			"t" : NumberLong(-1)
		},
		"lastSeenOpTimeAtElection" : {
			"ts" : Timestamp(1657829643, 1),
			"t" : NumberLong(-1)
		},
		"numVotesNeeded" : 1,
		"priorityAtElection" : 1,
		"electionTimeoutMillis" : NumberLong(10000),
		"newTermStartDate" : ISODate("2022-07-14T20:14:04.018Z"),
		"wMajorityWriteAvailabilityDate" : ISODate("2022-07-14T20:14:04.253Z")
	},
	"members" : [
		{
			"_id" : 0,
			"name" : "mongo-0.mongo:27017",
			"health" : 1,
			"state" : 1,
			"stateStr" : "PRIMARY",
			"uptime" : 1025171,
			"optime" : {
				"ts" : Timestamp(1658854696, 1),
				"t" : NumberLong(1)
			},
			"optimeDate" : ISODate("2022-07-26T16:58:16Z"),
			"lastAppliedWallTime" : ISODate("2022-07-26T16:58:16.556Z"),
			"lastDurableWallTime" : ISODate("2022-07-26T16:58:16.556Z"),
			"syncSourceHost" : "",
			"syncSourceId" : -1,
			"infoMessage" : "",
			"electionTime" : Timestamp(1657829643, 2),
			"electionDate" : ISODate("2022-07-14T20:14:03Z"),
			"configVersion" : 4,
			"configTerm" : 1,
			"self" : true,
			"lastHeartbeatMessage" : ""
		},
		{
			"_id" : 1,
			"name" : "mongo-1.mongo:27017",
			"health" : 1,
			"state" : 2,
			"stateStr" : "SECONDARY",
			"uptime" : 1025032,
			"optime" : {
				"ts" : Timestamp(1658854696, 1),
				"t" : NumberLong(1)
			},
			"optimeDurable" : {
				"ts" : Timestamp(1658854696, 1),
				"t" : NumberLong(1)
			},
			"optimeDate" : ISODate("2022-07-26T16:58:16Z"),
			"optimeDurableDate" : ISODate("2022-07-26T16:58:16Z"),
			"lastAppliedWallTime" : ISODate("2022-07-26T16:58:16.556Z"),
			"lastDurableWallTime" : ISODate("2022-07-26T16:58:16.556Z"),
			"lastHeartbeat" : ISODate("2022-07-26T16:58:22.471Z"),
			"lastHeartbeatRecv" : ISODate("2022-07-26T16:58:21.064Z"),
			"pingMs" : NumberLong(10),
			"lastHeartbeatMessage" : "",
			"syncSourceHost" : "mongo-0.mongo:27017",
			"syncSourceId" : 0,
			"infoMessage" : "",
			"configVersion" : 4,
			"configTerm" : 1
		}
	],
	"ok" : 1,
	"$clusterTime" : {
		"clusterTime" : Timestamp(1658854696, 1),
		"signature" : {
			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
			"keyId" : NumberLong(0)
		}
	},
	"operationTime" : Timestamp(1658854696, 1)
}

Relevant logs:

Start by reproducing the issue through Administration → Apps with the Jitsi app in the reported two-instance k3s setup, then inspect the API response and relevant server and browser logs. The work is done when installing the app consistently reports it as installed and the marketplace reflects that state.