Owner

JuliaPOMDP

46 indexed repositories · View on GitHub

POMDPs.jl
MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on...

Julia · 767 stars
MCTS.jl
Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework

Julia · 82 stars
DeepQLearning.jl
Implementation of the Deep Q-learning algorithm to solve MDPs

Julia · 77 stars
POMCPOW.jl
Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.

Julia · 59 stars
ParticleFilters.jl
Simple particle filter implementation in Julia - works with POMDPs.jl models or others.

Julia · 48 stars
BasicPOMCP.jl
The PO-UCT algorithm (aka POMCP) implemented in Julia

Julia · 39 stars
POMDPModels.jl
Problem models for testing POMDPs.jl

Jupyter Notebook · 34 stars
QuickPOMDPs.jl
Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers

Julia · 28 stars
quickpomdps
Interface for defining discrete and continuous-space MDPs and POMDPs in python. Compatible with the POMDPs.jl ecosystem.

Python · 26 stars
RLInterface.jl
Interface for deep reinforcement learning

Julia · 24 stars
DiscreteValueIteration.jl
Value iteration solver for MDPs

Julia · 21 stars
FactoredValueMCTS.jl
Scalable MCTS for team scenarios

Julia · 17 stars
SARSOP.jl
Julia package that wraps the SARSOP software for solving POMDPs/MDPs

Julia · 16 stars
ARDESPOT.jl
Implementation of the AR-DESPOT POMDP algorithm

Julia · 12 stars
TabularTDLearning.jl
Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA

Julia · 12 stars
POMDPSolve.jl
A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework

Julia · 11 stars
LocalApproximationValueIteration.jl

Julia · 10 stars
POMDPSimulators.jl
Simulators for POMDPs.jl

Julia · 9 stars
POMDPPolicies.jl

Julia · 9 stars
POMDPModelTools.jl
Useful extensions of the POMDPs.jl interface

Julia · 8 stars
26 more repositories live on View on GitHub

Beginner friendly Everything

Open All

Different initial bounds (LB/UB) across different machines Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

JuliaPOMDP/NativeSARSOP.jl#27 · 1 comment · Opened Apr 23, 2026
Initial Value in FIB Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

JuliaPOMDP/NativeSARSOP.jl#26 · 1 comment · Opened Nov 24, 2025
stable test_solver Open

Contribution Opportunity Learning Opportunity quick

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

JuliaPOMDP/POMDPs.jl#580 · 3 comments · Opened Nov 17, 2025
MOMDPs in NativeSARSOP Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

JuliaPOMDP/NativeSARSOP.jl#25 · 1 comment · Opened Nov 12, 2025
Ability to add custom callback function during solver runtime Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

JuliaPOMDP/POMCPOW.jl#46 · 3 comments · Opened Oct 10, 2025
Concreteness of `timer` and `callback` Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/MCTS.jl#115 · Opened Sep 29, 2025
Use of JuliaPOMDP with cognitive modelling package Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

JuliaPOMDP/POMDPs.jl#570 · 5 comments · Opened Jul 20, 2025
SARSOPSolver docstring inaccuracies Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

JuliaPOMDP/SARSOP.jl#70 · Opened Jun 27, 2025
Allows unspecified transitions without error or warning Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

JuliaPOMDP/POMDPXFiles.jl#31 · Opened Jun 27, 2025
Errors with MOMDP writer still references `pomdp` vs `momdp` Open

Difficulty 1/5 Under an hour Newbie friendliness 45/100

JuliaPOMDP/POMDPXFiles.jl#30 · Opened Jun 20, 2025
Update compat sections of all dependent packages Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

JuliaPOMDP/ParticleFilters.jl#77 · 1 comment · Opened Apr 11, 2025
Making 0.6 usable Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/ParticleFilters.jl#75 · Opened Apr 11, 2025
Add license file Open

Difficulty 1/5 Under an hour Newbie friendliness 25/100

JuliaPOMDP/GapHeuristicSearch.jl#6 · Opened Mar 28, 2025
POMDPX Documentation Site Unavailable Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

JuliaPOMDP/POMDPXFiles.jl#28 · Opened Feb 24, 2025
Action masking (feature request) Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

JuliaPOMDP/DeepQLearning.jl#77 · 7 comments · Opened Jan 13, 2025
Need help in defining and solving a POMDP: Varying Mountainhike Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

JuliaPOMDP/POMCPOW.jl#43 · 4 comments · Opened Nov 8, 2024
MetaGraphs -> MetaGraphsNext Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

JuliaPOMDP/TagPOMDPProblem.jl#11 · Opened Oct 18, 2024
Implement Adaptive Sequential Monte Carlo Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

JuliaPOMDP/ParticleFilters.jl#71 · 2 comments · Opened Aug 16, 2024
Deepcopy in DESPOTPlanner Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

JuliaPOMDP/ARDESPOT.jl#36 · Opened Aug 15, 2024
Corner Alpha Vectors Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

JuliaPOMDP/NativeSARSOP.jl#23 · Opened Jul 30, 2024
eltype for stepthrough Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/POMDPs.jl#558 · Opened Jul 10, 2024
Support for custom initial belief (e.g., solving many POMDPs with varying beliefs) Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

JuliaPOMDP/NativeSARSOP.jl#20 · 11 comments · Opened Jul 9, 2024
Archive repository Open

Difficulty 1/5 Under an hour Newbie friendliness 20/100

JuliaPOMDP/POMDPModelTools.jl#64 · Opened Jun 14, 2024
Archive repository Open

Difficulty 1/5 Under an hour Newbie friendliness 25/100

JuliaPOMDP/BeliefUpdaters.jl#31 · Opened Jun 14, 2024
Archive repository Open

Difficulty 1/5 Under an hour Newbie friendliness 25/100

JuliaPOMDP/POMDPSimulators.jl#53 · Opened Jun 14, 2024
Archive repository Open

Difficulty 1/5 1-3 hours Newbie friendliness 25/100

JuliaPOMDP/POMDPPolicies.jl#46 · Opened Jun 14, 2024
Archive repository Open

Difficulty 1/5 Under an hour Newbie friendliness 35/100

JuliaPOMDP/POMDPTesting.jl#18 · Opened Jun 14, 2024
Archive repository Open

Difficulty 1/5 Under an hour Newbie friendliness 20/100

JuliaPOMDP/POMDPReinforce.jl#5 · Opened Jun 14, 2024
Improved bootstrap filter Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

JuliaPOMDP/ParticleFilters.jl#68 · Opened Jun 12, 2024
TagBot trigger issue Open

Difficulty 1/5 Under an hour Newbie friendliness 35/100

JuliaPOMDP/POMDPLinter.jl#14 · 22 comments · Opened Jun 12, 2024
Fix things after 1.0 release Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

JuliaPOMDP/POMDPs.jl#550 · 5 comments · Opened Jun 12, 2024
updater for ValuePolicy Open

Contribution Opportunity Learning Opportunity quick

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/POMDPs.jl#548 · Opened May 14, 2024
ValuePolicy documentation Open

Contribution Opportunity documentation Learning Opportunity quick

Difficulty 1/5 Under an hour Newbie friendliness 55/100

JuliaPOMDP/POMDPs.jl#547 · Opened May 14, 2024
Registration Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

JuliaPOMDP/CompressedBeliefMDPs.jl#9 · 15 comments · Opened Apr 14, 2024
Add docstrings Open

contribution opportunity

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

JuliaPOMDP/POMDPModels.jl#99 · Opened Apr 7, 2024
Printout for parametric types missing commas Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

JuliaPOMDP/POMDPLinter.jl#13 · 1 comment · Opened Mar 18, 2024
POMDPs.value doesn't work w/ POMCPPlanner Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

JuliaPOMDP/BasicPOMCP.jl#37 · 1 comment · Opened Mar 17, 2024
GPU support Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

JuliaPOMDP/DeepQLearning.jl#69 · 2 comments · Opened Feb 15, 2024
State space is not fully aligned with Julia iteration interface Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

JuliaPOMDP/TagPOMDPProblem.jl#9 · Opened Feb 9, 2024
Visualization not compatible with POMDPs.jl ecosystem Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/VDPTag2.jl#16 · Opened Jan 26, 2024
Action masking feature (legal actions) Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

JuliaPOMDP/DeepQLearning.jl#68 · 1 comment · Opened Jan 24, 2024
printing output of `EpsGreedyPolicy(mdp, LinearDecaySchedule)` fails Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

JuliaPOMDP/POMDPModels.jl#98 · Opened Jan 24, 2024
Documentation About Problem Open

documentation

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

JuliaPOMDP/MultiAgentSysAdmin.jl#11 · Opened Dec 20, 2023
Documentation About Problem Open

documentation

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/MultiUAVDelivery.jl#11 · Opened Dec 20, 2023
Idea: Named variable declaration Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

JuliaPOMDP/QuickPOMDPs.jl#40 · Opened Dec 16, 2023
Use OrderedDict Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

JuliaPOMDP/ARDESPOT.jl#31 · 1 comment · Opened Oct 25, 2023
Issues using MaxUCB criterion Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

JuliaPOMDP/POMCPOW.jl#38 · 2 comments · Opened Oct 22, 2023
Switch to JuliaCall and JuliaPkg Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

JuliaPOMDP/quickpomdps#16 · 2 reactions · Opened Oct 10, 2023
value(policy, b, a) for AlphaVectorPolicy Open

Contribution Opportunity decision Learning Opportunity quick

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/POMDPs.jl#504 · 7 comments · Opened Jun 10, 2023
`read_pomdp` doesn't appear to fully implement the `.pomdp` spec. Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

JuliaPOMDP/POMDPFiles.jl#15 · 1 comment · Opened Jun 9, 2023

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

JuliaPOMDP

Showing the newest 100

Get new issues in your inbox