fly-apps / fly-apps/live_beats

Passing passing file to FLAME worker through S3FS

Open
#78 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Elixir
Stars
1.4k
Forks
182
PR merge metrics
No merged PRs in 30d

Description

Irc, @chrismccord you mention somewhere that the file can be passed to worker through message passing. But it's not being used here. So I am curious about:
1. Would passing file through streaming over OTP mesh a bad idea? What are the drawbacks?
2. If the request arrive faster than Tigris replication. What would happen?

Thank you.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names the FLAME worker, S3FS, the OTP mesh, and Tigris replication, but no files or tests. Start by locating the worker handoff and storage integration, then investigate streaming through the mesh and requests arriving before replication. Done would require a decided approach and documented or implemented behavior for both cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
elixir
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.