LikeLike

LikeLike

Hi Freek-san. Please specify “ObservationFromFullStats” in mission and determine rewards in your custom env. You can get the following information (positions, life, etc) with this setting, “ObservationFromFullStats”.
https://microsoft.github.io/malmo/0.21.0/Schemas/MissionHandlers.html
If it doesn’t meet your requirements, please see other observation options you can use in the above document. (You can use other observation options together with ObservationFromFullStats.)

LikeLike

LikeLike

Yes, the agent interacts with minecraft server (w/ malmo mod) using socket (TCP) communication.
I’m sorry since I’m not familiar with implementation details, but the agent (see AgentHost.cpp below) holds the socket communication as observations_server, video_server, etc. These “server” objects are all implemented as StringServer (StringServer.cpp), which uses TCPServer (TCPServer.cpp) for underlying TCP connection. As you can see in TCPServer.cpp, it handles the received message in its callback. When you peek states, these message will be returned to the client.
As you know, python implementation is just wrapping these native C++ implementation.
MineRL will also be using this malmo implementation at the bottom.

AgentHost.cpp
https://github.com/microsoft/malmo/blob/master/Malmo/src/AgentHost.cpp

StringServer.cpp
https://github.com/microsoft/malmo/blob/master/Malmo/src/StringServer.cpp

TCPServer.cpp
https://github.com/microsoft/malmo/blob/master/Malmo/src/TCPServer.cpp

LikeLike

Yes, I already change my code to peekWorldState()

But, I still want to know how can I obtain the world_state ( = agent_host.peekWorldState()) information in MineRL or Malmo. Do you know how to generate my own environment? I have read the code of MineRL and MalmoEnv , the key code seems talks about socket sendMessage to Minecraft Server or receive Message from Minecraft server, As far as I consider , the Minecraft server provide all kinds of message, but I can not find how to receive message including world_state, Do you have experience of this problem ? can You help me?

LikeLike

I think that more appropriate function for getting world state might be AgentHost::peekWorldState() in malmo. (See https://github.com/microsoft/malmo/pull/96 )
peekWorldState() can also be used in python with MalmoPython (see the source code in https://github.com/microsoft/malmo/tree/master/Malmo/samples/Python_examples ), but I think you might have to generate your own environments, when you need gym-like environments with peekWorldState().

import MalmoPython
agent_host = MalmoPython.AgentHost()
world_state = agent_host.peekWorldState()

LikeLike

Looking for your reply!
Great post !

LikeLike

360DigiTMG

LikeLike

LikeLike