Questions tagged [robotics]
For questions and clarifications about the use of AI/ML algorithms in the field of robotics.
49 questions
0 votes
0 answers
51 views
How far are we from developing a robot that can cook and be controlled remotely?
How far are we from developing a robot that can cook at a stove with utensils pots and ingredients, and that can be operated with a visor and limb remote controls?
0 votes
1 answer
73 views
For the observation vector as input to the control policy in RL project, should I include important but fixed information?
I am trying to use PPO algorithm to train a novel robotic manipulator to reach a target position in its workspace. What should I include to the observation vector, which works as the input to the ...
0 votes
1 answer
80 views
Creating a Dynamic Heat Map for Multi-Agent Path Planning
I’m working on a system where agents must move scattered objects (aggregates) from various locations (cells) to a target zone. The environment is divided into a grid of cells, where each cell contains ...
3 votes
1 answer
120 views
Are PDDL and classical planners (e.g. FF) used in industry or consumer products?
I am learning classical planning techniques, and I know many examples of robots are in books. However, I am more curious about the real-world usage of these techniques. Are PDDL and classical planners ...
1 vote
0 answers
44 views
Why some papers focus on constructing large dataset from real robots, instead of simulations?
Recently, I have seen papers about large datasets for robotics such as DROID(https://droid-dataset.github.io/) or Open X-Embodiment(https://robotics-transformer-x.github.io/). As I see, the datasets ...
0 votes
1 answer
170 views
RL simulation: Does the Gym-like RL training solution fits the real-world environments?
I am new to the RL community and I am working on projects about using RL to control robots like drones to fly in the scenes. I have been using Nvidia's Issac Gym for some time, but I have a question ...
1 vote
1 answer
126 views
Which type of Machine Learning is used in robots? [closed]
Which type of Machine Learning is used in robots? Is it supervised learning or unsupervised learning or Reinforcement learning? Especially the robots that were sent in space?
3 votes
0 answers
62 views
What is the current state of AI regarding features of Moravec's paradox, such as sensorimotor & perception skills?
Moravec's paradox is the observation in artificial intelligence and robotics that, contrary to traditional assumptions, reasoning requires very little computation, but sensorimotor and perception ...
1 vote
1 answer
694 views
Reinforcement Learning vs Supervised Learning [duplicate]
I have never tried reinforcement learning in my life. I'm planning to apply it in robotics. I have some experiences using supervised learning mainly deep learning. So, that's mean I will use neural ...
2 votes
1 answer
383 views
Can I train an agent with DQN, avoiding obstacles and still finding the optimal path to finish the task?
The agent is supposed to visit specific locations (which is also different each time) and it may encounters obstacles. The goal is to visit those locations with the shortest path possible without ...
3 votes
1 answer
302 views
Can DQN find optimal path while avoiding random obstacles?
Can an agent trained with a DQN algorithm in a grid world, avoid obstacles (randomly appearing during the run time) and still find the optimal path to finish a task? The agent is supposed to visit ...
2 votes
0 answers
349 views
What are the limitations of hierarchical reinforcement learning?
Hierarchical Reinforcement Learning is suited to tackle many complex problems such as robotics manipulation. Sticking to this example, the basic idea is that instead of learning a sequence of robotic ...
2 votes
0 answers
31 views
How do multiple coordinate systems help in capturing invariant features?
I've been reading this paper that formulates invariant task-parametrized HSMMs. The task parameters are represented in $F$ coordinate systems defined by $\{A_j,b_j\}_{j=1}^F$, where $A_j$ denotes the ...
1 vote
0 answers
29 views
How do I find the data-point with respect to a given frame?
I've been reading this paper that formulates invariant task-parametrized HSMMs. In section 3.1 (Model Learning), the task parameters are represented in $F$ coordinate systems defined by $\{A_j,b_j\}_{...
4 votes
0 answers
117 views
Difficulty in agent's learning with increasing dimensions of continuous actions
I have been working on some RL project, where the policy is controlling the robot using its joint angles.Throughout the project I have noticed some phenomenon, which caught my attention. I have ...