aws-samples / aws-samples/amazon-managed-service-for-apache-flink-examples

RANDOM CUT FOREST

Open
#128 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Java
Stars
92
Forks
47
PR merge metrics
No merged PRs in 30d

Description

I am trying to build a real time anomoly detection using kinesis data streams and reading data from streams in amazon managed flink and detecting anomoly using RCF using python wrapper

I am trying to run random cut forest using python in amazon managed flink

to load the jar files of RCF in python which i did locally

def start_jvm():
if not jpype.isJVMStarted():
lib_dir = Path(file).parent / "lib"
jar_path = str(lib_dir / "*")
# jar_path = "lib_2/randomcutforest-core-4.0.0-SNAPSHOT.jar:lib_2/randomcutforest-parkservices-4.0.0-SNAPSHOT.jar"
jpype.addClassPath(jar_path)
print(f"Starting JVM with classpath: {jar_path}")
jpype.startJVM(convertStrings=False)
print("JVM started successfully.")
else:
print("JVM already started.")

i need to stat jvm which is running file in my local .

but i am unable to run in amaon managed flink

how to achieve it .Thanks in advance

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the start_jvm() snippet and local lib JAR/classpath setup described in the issue. Compare that setup with the Amazon Managed Service for Apache Flink runtime and reproduce the JVM or classpath failure there. Done means documenting a working way to load the Random Cut Forest JARs and run the Python anomaly-detection flow.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, data-engineering, stream-processing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.