title: How to control the mouse in Minecraft using Python?
body: <h1>All in all, I'm trying to programmatically -and externally- control the Minecraft player's orientation.</h1>
  <h3>No APIs, no Java mods to the game environment</h3>
  <p>Typically this requires the movement of the mouse, but every single mouse movement simulating python3 library that I've tried doesn't move the player's head in-game. Each library does something different, too.</p>
  <p>For example, pyautogui doesn't do anything until you move the mouse manually after the script has finished. Doing this will jerk the player's view to where the program supposedly moved it to, before continuing to follow your current mouse movements. This happens for both mouse commands.</p>
  <pre><code>import pyautogui
  
  pyautogui.moveTo(500, 500)
  pyautogui.moveRel(100, 100)  
  </code></pre>
  <p>The pynput library had the same weird result as pyautogui:</p>
  <pre><code>from pynput.mouse import Controller
  
  mouse = Controller()
  
  mouse.position = (100, 200)
  mouse.move(200, -100)
  </code></pre>
  <p>Quartz doesn't do anything at all:</p>
  <pre><code>import Quartz
  
  class Mouse():
      down = [Quartz.kCGEventLeftMouseDown, Quartz.kCGEventRightMouseDown, Quartz.kCGEventOtherMouseDown]
      up = [Quartz.kCGEventLeftMouseUp, Quartz.kCGEventRightMouseUp, Quartz.kCGEventOtherMouseUp]
      [LEFT, RIGHT, OTHER] = [0, 1, 2]
  
      def click_pos(self, x, y, button=LEFT):
          self.move(x, y)
          self.click(button)
  
      def to_relative(self, x, y):
          curr_pos = Quartz.CGEventGetLocation( Quartz.CGEventCreate(None) )
          x += curr_pos.x;
          y += curr_pos.y;
  
  
  mouse = Mouse()
  mouse.to_relative(200, 200)
  </code></pre>
  <p>And the python mouse library is outdated: the error showed that it will only run on Darwin (I'm on macOS High Sierra). I was sad on learning this because of the description on the <a href="https://github.com/boppreh/mouse" rel="noreferrer">Github</a> page. It says <em>&quot;Global event hook on all mice devices (captures events regardless of focus)&quot;</em>. I then thought that, somehow, Minecraft was sucking up all the simulated mouse movements on it's own. Either way, I'm not using the right interface for this game, and I need something that can bypass Minecraft's interesting mouse controls to get the movement that I want.</p>
  <p>I even tried using <em>mouse keys</em> (mac's mouse-moving accessibility feature that lets you control the mouse with only keys) along with pyautogui.</p>
  <pre><code>import pyautogui # with mouse keys on
  import time
  # mouse keys is an accessibility feature on mac that controls the mouse with the keyboard
  
  print(&quot;[ALERT]: Make sure mouse keys is on! (press option 5 times if shortcut is enabled)&quot;)
  
  pyautogui.keyDown('8')  # up in mouse keys
  time.sleep(5)
  pyautogui.keyUp('8')
  </code></pre>
  <p>I wasn't particularly surprised that the last one didn't work, but I think I'm running out of ways to try and bypass whatever is making Minecraft not take my python-mouse input. At this point, I'm pretty sure that there must be some distinction in the kind of input that I'm giving the computer. Minecraft as a program doesn't use the mouse like other programs do, and python mice don't control the mouse like other sources do, so there is a disconnect.</p>
  <p>I'm on my macOS High Sierra running Minecraft in both fullscreen and windowed mode, trying everything I can to get this to function properly. I'll start the test script (python 3.6) in PyCharm, change windows (or window focus) to Minecraft (with adequate delay time in-program), and then witness what happens. Mouse clicking, keyboard presses, and even hotkeys that involve the command and escape keys all work fine in Minecraft with pyautogui, so I'm not worried about those at all. It's literally just the mouse movement that's not doing anything.</p>
  <p>First of all, is this the right place to ask this question? Is there anything else to try, or is there something crucial that I'm missing, that would allow my mouse input to be responded to correctly?</p>