harshraj22 / harshraj22/cropRL

Ideas and suggestions

Open
#2 11 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Questions:
- ~what is Base Yield~
- ~what is Base Price~
- ~Soil Impact is it rate per month ? ~
- ~Soil is impacted based on the crop grown ? to verify~
- ~To verify, debt uses the interest rate at which the loan was taken and not the current interest rate~
- TEST: to verify that debt keeps on increasing per month based on the interest rate
- ~to verify that new loan is not given if existing loan is not paid off~
- ~Add more enums pairs for allowed action/ two timers, one for month, one for episode length, for invalid action, month does not increase but episode length does, invalid action gives negative reward, final reward at the end of trajectory also ~
- Reward function: ToDo: delta of net worth, agent to learn soil fertility impacts the long term reward.
- Reward at the end of trajectory should also consider the number of months not observed by the agent.
- ~Reduce land cost per month, similar to poker~
- ~Market Prices formula~
- ~Yield Noise~
- Long term deman shocks for sensational crop (increases demand of a crop for a long duration, say 6 months, to simulate demand shocks) eg. macha
- Seasonal Price Multipliers: should be per crop basis
- ~Action to remove extra water/rainfall from the field, to prevent crop damage~
- Improve readme to add novelty of the environment, how it is different from other environments, and how it can be used for research in RL and economics.
- Check how is reward function in chess defined.

networth = assets - liabilities
iteration 1:
loan = x
current_cash_before_loan = y
networth_before_loan = y
networth_after_loan = y - x
diff = -x

iteration 2:
seed_cost = z
current_cash_before_seed = y + x
networth_before_seed = y - x
networth_after_seed = y - x - z

10_000, 10_000 + 5_000: diff = -5_000
seed = 6_000

9_000 (1_000 + 5_000, 9_000) : actual_networth = 9_000 - 5_000 = 4_000

a1,
a2,
a3
....
az = cash - loan + yeild potential + stored crop yeild potential

az - a1 = (az - ay) + (ay - ax) + (ax - .)...(a2 - a1)

INT_MAX - (R1 + R2 + R3)

Ideas:
- Rent/Lease neighbouring Land
- ~Water requirement for each crop~
- ~Suitable weather for each crop (Yield potential should be impacted if wrong crop is grown in different weather)~
- ~Yield potential should depend on soil fertility~

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Start by reviewing the unchecked ideas and the net-worth and reward notes, then identify which single behavior is intended for implementation. Done should include a clearly scoped change and verification of the selected crop, loan, market, or reward behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.