Ok I figured this out. If you need links in your context menu just htmlencode them and put it in the label attribute. For example
Code:
<menuItem label="<a href="/path/to/page.php" target="_blank">Link Name</a>" id="some_id" />