GitLab supports creating new issues via email.
It does this by creating a unique email address that you can use to open new issues.
To find this, login to gitlab and navigate to your project:
Head to the bottom of the page, and click the link email an issue to this project
You can then just create a contact record in your mail record and viola, open issues via email!