tambetm / gym-minecraft Goto Github PK

View Code? Open in Web Editor NEW

272.0 272.0 29.0 1.29 MB

Minecraft environment for Open AI Gym, based on Microsoft's Malmo.

Python 95.24% Shell 0.30% Dockerfile 4.47%

gym-minecraft's People

Contributors

Stargazers

Watchers

gym-minecraft's Issues

use of target_network in duel.py (in example)

Hi,

I have been exploring your example code of dual networks in dqn.
In that, I don't see how the target network is really used in your implementation. Its weights are updated at constant intervals, but you don't "use" it anywhere.
The existence of target network is to compute the target_q values right? which is 'qpost' in your code if I am not mistaken.
So, shouldn't line 144 be

qpost = target_model.predict(poststates)

instead of

qpost = model.predict(poststates)

Please correct me if I'm wrong, I am still learning about dqns! :)

Multiplayer Support

Multiplayer support would be a great add-on.
Just a feature request.

Does client_pool work?

I keep getting this error when running env.init(client_pool=[('127.0.0.1', 10001)]). I've launched the Malmo server using ./launchClient -port 10001.
Error:
Error starting mission: Failed to find an available client for this mission - tried all the clients in the supplied client pool.

How can I get the bird's-eye map when use my own XML enviroment?

_configure() got an unexpected keyword argument

Hello,
after I installed minecraft-py, launch minecraft is ok. but, run examples/test.py or others code always got _configure() got an unexpected keyword argument:

python test.py
[2017-01-10 10:30:28,995] Making new env: MinecraftBasic-v0
Traceback (most recent call last):
File "test.py", line 7, in
env.configure(allowDiscreteMovement=["move", "turn"], log_level="INFO")
File "/Users/jomyhuang/Desktop/dev/gym/gym/core.py", line 230, in configure
reraise(suffix='(for {})'.format(self.spec.id))
File "/Users/jomyhuang/Desktop/dev/gym/gym/utils/reraise.py", line 17, in reraise
reraise_impl(e, traceback)
File "/Users/jomyhuang/Desktop/dev/gym/gym/core.py", line 224, in configure
self._configure(*args, **kwargs)
gym.utils.reraise.ReraisedException: The original exception was:

exceptions.TypeError: _configure() got an unexpected keyword argument 'allowDiscreteMovement'

(for MinecraftBasic-v0)

Problem parsing XML or accessing AgentObservationsPort?

I just installed gym-minecraft and I'm trying to run the first default mission ('MinecraftBasic-v0'), but having problems getting the mission to start. I'm using the test.py code:

import logging
logging.basicConfig(level=logging.DEBUG)

import gym
import gym_minecraft

env = gym.make('MinecraftBasic-v0')
env.init(start_minecraft=True)
env.reset()

done = False
while not done:
        env.render()
        action = env.action_space.sample()
        obs, reward, done, info = env.step(action)
        
env.close()

Minecraft starts, but then I get this error:

INFO:minecraft_py:Minecraft process ready
INFO:gym_minecraft.envs.minecraft_env:Started Minecraft on port 10000, overriding client_pool.
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:crouch
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:jump
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:move
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:pitch
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:strafe
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:turn
DEBUG:gym_minecraft.envs.minecraft_env:ContinuousMovement:use
DEBUG:gym_minecraft.envs.minecraft_env:Discrete(14)
WARNING:gym_minecraft.envs.minecraft_env:Error starting mission: Internal error: the XML we generate does not validate: instance document parsing failed
:1:2897 error: element 'AgentObservationsPort' is not allowed for content model '(ClientIPAddress,ClientMissionControlPort,ClientCommandsPort,AgentIPAddress,AgentMissionControlPort,AgentVideoPort,AgentDepthPort,AgentLuminancePort,AgentObservationsPort,AgentRewardsPort,AgentColourMapPort)'
<?xml version="1.0" encoding="UTF-8" standalone="no" ?><MissionInit xmlns="http://ProjectMalmo.microsoft.com" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://ProjectMalmo.microsoft.com MissionInit.xsd"><Mission><About><Summary>Find the goal!</Summary></About><ModSettings><PrioritiseOffscreenRendering>true</PrioritiseOffscreenRendering></ModSettings><ServerSection><ServerInitialConditions><Time><StartTime>6000</StartTime><AllowPassageOfTime>false</AllowPassageOfTime></Time><Weather>clear</Weather><AllowSpawning>false</AllowSpawning></ServerInitialConditions><ServerHandlers><FlatWorldGenerator destroyAfterUse="true" forceReset="false" generatorString="3;7,220*1,5*3,2;3;,biome_1" seed=""/><ClassroomDecorator seed="__SEED__"><specification><width>7</width><height>7</height><length>7</length><pathLength>0</pathLength><divisions><southNorth>0</southNorth><eastWest>0</eastWest><aboveBelow>0</aboveBelow></divisions><horizontalObstacles><gap>0</gap><bridge>0</bridge><door>0</door><puzzle>0</puzzle><jump>0</jump></horizontalObstacles><verticalObstacles><stairs>0</stairs><ladder>0</ladder><jump>0</jump></verticalObstacles><hintLikelihood>1</hintLikelihood></specification></ClassroomDecorator><ServerQuitFromTimeUp description="out_of_time" timeLimitMs="30000"/><ServerQuitWhenAnyAgentFinishes description=""/></ServerHandlers></ServerSection><AgentSection mode="Survival"><Name>James Bond</Name><AgentStart><Placement pitch="0" x="-203.5" y="81" yaw="0" z="217.5"/></AgentStart><AgentHandlers><ObservationFromFullStats/><VideoProducer viewpoint="0" want_depth="false"><Width>320</Width><Height>240</Height></VideoProducer><RewardForTouchingBlockType dimension="0"><Block behaviour="oncePerBlock" cooldownInMs="1000" reward="20" type="gold_ore diamond_ore redstone_ore"/></RewardForTouchingBlockType><RewardForSendingCommand dimension="0" reward="-1"/><RewardForMissionEnd dimension="0" rewardForDeath="-10000"><Reward description="found_goal" reward="1000"/><Reward description="out_of_time" reward="-1000"/></RewardForMissionEnd><ContinuousMovementCommands turnSpeedDegs="180"><ModifierList type="deny-list"><command>attack</command></ModifierList></ContinuousMovementCommands><AgentQuitFromTouchingBlockType><Block description="found_goal" type="gold_block diamond_block redstone_block"/></AgentQuitFromTouchingBlockType></AgentHandlers></AgentSection></Mission><ExperimentUID>experiment_id</ExperimentUID><ClientRole>0</ClientRole><ClientAgentConnection><ClientIPAddress>127.0.0.1</ClientIPAddress><ClientMissionControlPort>10000</ClientMissionControlPort><ClientCommandsPort>0</ClientCommandsPort><AgentIPAddress>127.0.0.1</AgentIPAddress><AgentMissionControlPort>10035</AgentMissionControlPort><AgentVideoPort>10472</AgentVideoPort><AgentObservationsPort>10416</AgentObservationsPort><AgentRewardsPort>10309</AgentRewardsPort></ClientAgentConnection></MissionInit>

INFO:gym_minecraft.envs.minecraft_env:Sleeping for 10 seconds...

I haven't changed any of the xml files, and the xml text is structurally valid. I also tried loading the mission file from another source:

env = gym.make('MinecraftBasic-v0')
env.load_mission_file("basic2.xml")

The script loaded the mission file correctly, but I still get the same error.

Then there's the other error: error: element 'AgentObservationsPort' is not allowed for content model . This seems to be linked to the ClientAgentConnection in Malmo https://github.com/Microsoft/malmo/blob/master/Schemas/MissionInit.xsd

Any help would be much appreciated!

Compilation problems

Hey,

I ran into some problems when trying to compile Minecraft / minecraft_py as per the README's instructions. Basically I followed the instructions up until the point where you try to run minecraft_py for the first time (code inside the snippet below, first lines). Does anyone have an idea what's going on?

`In [1]: import logging
...: logging.basicConfig(level=logging.DEBUG)
...:
...: import minecraft_py
...:
...: proc, port = minecraft_py.start()
...: minecraft_py.stop(proc)
...:
INFO:minecraft_py:Starting Minecraft process: /usr/local/lib/python2.7/dist-packages/minecraft_py-0.0.2-py2.7.egg/minecraft_py/Malmo/Minecraft/launchClient.sh -port 10000
DEBUG:minecraft_py:Failed to notify ProjectEvaluationListener.afterEvaluate(), but primary configuration failure takes precedence.

DEBUG:minecraft_py:java.lang.RuntimeException: MISSING REPLACEMENT DATA FOR API_GROUP_DIR

DEBUG:minecraft_py: at net.minecraftforge.gradle.util.delayed.TokenReplacer.replace(TokenReplacer.java:83)

DEBUG:minecraft_py: at net.minecraftforge.gradle.util.delayed.DelayedBase.call(DelayedBase.java:34)

DEBUG:minecraft_py: at org.gradle.api.internal.file.AbstractFileResolver.unpack(AbstractFileResolver.java:201)

DEBUG:minecraft_py: at org.gradle.api.internal.file.AbstractFileResolver.convertObjectToFile(AbstractFileResolver.java:186)

DEBUG:minecraft_py: at org.gradle.api.internal.file.BaseDirFileResolver.doResolve(BaseDirFileResolver.java:71)

DEBUG:minecraft_py: at org.gradle.api.internal.file.AbstractFileResolver.resolve(AbstractFileResolver.java:84)

DEBUG:minecraft_py: at org.gradle.api.internal.file.AbstractFileResolver.resolve(AbstractFileResolver.java:66)

DEBUG:minecraft_py: at org.gradle.api.internal.file.DefaultFileOperations.file(DefaultFileOperations.java:73)

DEBUG:minecraft_py: at org.gradle.api.internal.project.AbstractProject.file(AbstractProject.java:649)

DEBUG:minecraft_py: at net.minecraftforge.gradle.user.UserBasePlugin$3.execute(UserBasePlugin.java:391)

DEBUG:minecraft_py: at net.minecraftforge.gradle.user.UserBasePlugin$3.execute(UserBasePlugin.java:386)

DEBUG:minecraft_py: at org.gradle.internal.event.BroadcastDispatch$ActionInvocationHandler.dispatch(BroadcastDispatch.java:93)

DEBUG:minecraft_py: at org.gradle.internal.event.BroadcastDispatch$ActionInvocationHandler.dispatch(BroadcastDispatch.java:82)

DEBUG:minecraft_py: at org.gradle.internal.event.AbstractBroadcastDispatch.dispatch(AbstractBroadcastDispatch.java:44)

DEBUG:minecraft_py: at org.gradle.internal.event.BroadcastDispatch.dispatch(BroadcastDispatch.java:79)

DEBUG:minecraft_py: at org.gradle.internal.event.BroadcastDispatch.dispatch(BroadcastDispatch.java:30)

DEBUG:minecraft_py: at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)

DEBUG:minecraft_py: at com.sun.proxy.$Proxy11.afterEvaluate(Unknown Source)

DEBUG:minecraft_py: at org.gradle.configuration.project.LifecycleProjectEvaluator.notifyAfterEvaluate(LifecycleProjectEvaluator.java:67)

DEBUG:minecraft_py: at org.gradle.configuration.project.LifecycleProjectEvaluator.evaluate(LifecycleProjectEvaluator.java:61)

DEBUG:minecraft_py: at org.gradle.api.internal.project.AbstractProject.evaluate(AbstractProject.java:521)

DEBUG:minecraft_py: at org.gradle.api.internal.project.AbstractProject.evaluate(AbstractProject.java:92)

DEBUG:minecraft_py: at org.gradle.execution.TaskPathProjectEvaluator.configureHierarchy(TaskPathProjectEvaluator.java:42)

DEBUG:minecraft_py: at org.gradle.configuration.DefaultBuildConfigurer.configure(DefaultBuildConfigurer.java:35)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher$2.run(DefaultGradleLauncher.java:125)

DEBUG:minecraft_py: at org.gradle.internal.Factories$1.create(Factories.java:22)

DEBUG:minecraft_py: at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)

DEBUG:minecraft_py: at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:52)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher.doBuildStages(DefaultGradleLauncher.java:122)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher.access$200(DefaultGradleLauncher.java:32)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher$1.create(DefaultGradleLauncher.java:99)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher$1.create(DefaultGradleLauncher.java:93)

DEBUG:minecraft_py: at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)

DEBUG:minecraft_py: at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:62)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher.doBuild(DefaultGradleLauncher.java:93)

DEBUG:minecraft_py: at org.gradle.initialization.DefaultGradleLauncher.run(DefaultGradleLauncher.java:82)

DEBUG:minecraft_py: at org.gradle.launcher.exec.InProcessBuildActionExecuter$DefaultBuildController.run(InProcessBuildActionExecuter.java:94)

DEBUG:minecraft_py: at org.gradle.tooling.internal.provider.ExecuteBuildActionRunner.run(ExecuteBuildActionRunner.java:28)

DEBUG:minecraft_py: at org.gradle.launcher.exec.ChainingBuildActionRunner.run(ChainingBuildActionRunner.java:35)

DEBUG:minecraft_py: at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:43)

DEBUG:minecraft_py: at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:28)

DEBUG:minecraft_py: at org.gradle.launcher.exec.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:75)

DEBUG:minecraft_py: at org.gradle.launcher.exec.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:45)

DEBUG:minecraft_py: at org.gradle.launcher.exec.DaemonUsageSuggestingBuildActionExecuter.execute(DaemonUsageSuggestingBuildActionExecuter.java:51)

DEBUG:minecraft_py: at org.gradle.launcher.exec.DaemonUsageSuggestingBuildActionExecuter.execute(DaemonUsageSuggestingBuildActionExecuter.java:28)

DEBUG:minecraft_py: at org.gradle.launcher.cli.RunBuildAction.run(RunBuildAction.java:43)

DEBUG:minecraft_py: at org.gradle.internal.Actions$RunnableActionAdapter.execute(Actions.java:170)

DEBUG:minecraft_py: at org.gradle.launcher.cli.CommandLineActionFactory$ParseAndBuildAction.execute(CommandLineActionFactory.java:237)

DEBUG:minecraft_py: at org.gradle.launcher.cli.CommandLineActionFactory$ParseAndBuildAction.execute(CommandLineActionFactory.java:210)

DEBUG:minecraft_py: at org.gradle.launcher.cli.JavaRuntimeValidationAction.execute(JavaRuntimeValidationAction.java:35)

DEBUG:minecraft_py: at org.gradle.launcher.cli.JavaRuntimeValidationAction.execute(JavaRuntimeValidationAction.java:24)

DEBUG:minecraft_py: at org.gradle.launcher.cli.CommandLineActionFactory$WithLogging.execute(CommandLineActionFactory.java:206)

DEBUG:minecraft_py: at org.gradle.launcher.cli.CommandLineActionFactory$WithLogging.execute(CommandLineActionFactory.java:169)

DEBUG:minecraft_py: at org.gradle.launcher.cli.ExceptionReportingAction.execute(ExceptionReportingAction.java:33)

DEBUG:minecraft_py: at org.gradle.launcher.cli.ExceptionReportingAction.execute(ExceptionReportingAction.java:22)

DEBUG:minecraft_py: at org.gradle.launcher.Main.doAction(Main.java:33)

DEBUG:minecraft_py: at org.gradle.launcher.bootstrap.EntryPoint.run(EntryPoint.java:45)

DEBUG:minecraft_py: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

DEBUG:minecraft_py: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

DEBUG:minecraft_py: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

DEBUG:minecraft_py: at java.lang.reflect.Method.invoke(Method.java:498)

DEBUG:minecraft_py: at org.gradle.launcher.bootstrap.ProcessBootstrap.runNoExit(ProcessBootstrap.java:54)

DEBUG:minecraft_py: at org.gradle.launcher.bootstrap.ProcessBootstrap.run(ProcessBootstrap.java:35)

DEBUG:minecraft_py: at org.gradle.launcher.GradleMain.main(GradleMain.java:23)

DEBUG:minecraft_py: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

DEBUG:minecraft_py: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

DEBUG:minecraft_py: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

DEBUG:minecraft_py: at java.lang.reflect.Method.invoke(Method.java:498)

DEBUG:minecraft_py: at org.gradle.wrapper.BootstrapMainStarter.start(BootstrapMainStarter.java:30)

DEBUG:minecraft_py: at org.gradle.wrapper.WrapperExecutor.execute(WrapperExecutor.java:127)

DEBUG:minecraft_py: at org.gradle.wrapper.GradleWrapperMain.main(GradleWrapperMain.java:61)

DEBUG:minecraft_py:

DEBUG:minecraft_py:FAILURE: Build failed with an exception.

DEBUG:minecraft_py:

DEBUG:minecraft_py:* Where:

DEBUG:minecraft_py:Build file '/usr/local/lib/python2.7/dist-packages/minecraft_py-0.0.2-py2.7.egg/minecraft_py/Malmo/Minecraft/build.gradle' line: 25

DEBUG:minecraft_py:

DEBUG:minecraft_py:* What went wrong:

DEBUG:minecraft_py:A problem occurred evaluating root project 'Minecraft'.

DEBUG:minecraft_py:> version.properties file is missing - this is created automatically by CMake. If you are building from source, make sure you have built the full source tree, not just the Minecraft folder.

DEBUG:minecraft_py:

DEBUG:minecraft_py:* Try:

DEBUG:minecraft_py:Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

DEBUG:minecraft_py:

DEBUG:minecraft_py:BUILD FAILED

DEBUG:minecraft_py:

DEBUG:minecraft_py:Total time: 5.425 secs

DEBUG:minecraft_py:Failed to notify ProjectEvaluationListener.afterEvaluate(), but primary configuration failure takes precedence.