harshraj22 / harshraj22/cropRL
Ideas and suggestions
- Dominant language
- Python
- Stars
- 0
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
Questions:
- ~what is Base Yield~
- ~what is Base Price~
- ~Soil Impact is it rate per month ? ~
- ~Soil is impacted based on the crop grown ? to verify~
- ~To verify, debt uses the interest rate at which the loan was taken and not the current interest rate~
- TEST: to verify that debt keeps on increasing per month based on the interest rate
- ~to verify that new loan is not given if existing loan is not paid off~
- ~Add more enums pairs for allowed action/ two timers, one for month, one for episode length, for invalid action, month does not increase but episode length does, invalid action gives negative reward, final reward at the end of trajectory also ~
- Reward function: ToDo: delta of net worth, agent to learn soil fertility impacts the long term reward.
- Reward at the end of trajectory should also consider the number of months not observed by the agent.
- ~Reduce land cost per month, similar to poker~
- ~Market Prices formula~
- ~Yield Noise~
- Long term deman shocks for sensational crop (increases demand of a crop for a long duration, say 6 months, to simulate demand shocks) eg. macha
- Seasonal Price Multipliers: should be per crop basis
- ~Action to remove extra water/rainfall from the field, to prevent crop damage~
- Improve readme to add novelty of the environment, how it is different from other environments, and how it can be used for research in RL and economics.
- Check how is reward function in chess defined.
networth = assets - liabilities
iteration 1:
loan = x
current_cash_before_loan = y
networth_before_loan = y
networth_after_loan = y - x
diff = -x
iteration 2:
seed_cost = z
current_cash_before_seed = y + x
networth_before_seed = y - x
networth_after_seed = y - x - z
10_000, 10_000 + 5_000: diff = -5_000
seed = 6_000
9_000 (1_000 + 5_000, 9_000) : actual_networth = 9_000 - 5_000 = 4_000
a1,
a2,
a3
....
az = cash - loan + yeild potential + stored crop yeild potential
az - a1 = (az - ay) + (ay - ax) + (ax - .)...(a2 - a1)
INT_MAX - (R1 + R2 + R3)
Ideas:
- Rent/Lease neighbouring Land
- ~Water requirement for each crop~
- ~Suitable weather for each crop (Yield potential should be impacted if wrong crop is grown in different weather)~
- ~Yield potential should depend on soil fertility~
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named. Start by reviewing the unchecked ideas and the net-worth and reward notes, then identify which single behavior is intended for implementation. Done should include a clearly scoped change and verification of the selected crop, loan, market, or reward behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100