Connect while on battery supply

I got my BrickPi today, including the AA battery pack. The Pi is all setup and I can connect via WiFi using VNC if I plug it into the wall using the USB plug but if I’m only running on battery power it doesn’t look like it supplies enough power to connect. Should I be able to connect via VNC over WiFi while on battery power?

Thanks

jrod0725,
Can you tell me more about the following:

  • What’s connected to the BrickPi? Sensors and Motors?
  • What version of the BrickPi do you have? Advanced Power?
  • What do you have connected to the RPi? Anything other than WIFI USB?
  • Do you have a voltmeter and can you test how much voltage you have on your AA’s?

Thanks!