Predictive business process monitoring is a challenging time series task due to the complex and dynamic nature of business processes, which involves predicting the ongoing cases in terms of the next activity, activity suffix, and remaining time prediction on a business process. Temporal point processes (TPPs) are widely used to model sequences of events happening at irregular intervals, to model the occurrence times of events, and to capture the temporal dependencies among them. With the recent advances in deep neural networks, deep TPPs have emerged as a promising approach for capturing complex patterns in event sequences with occurrence timestamps. Hence, deep TPPs can be a potential approach to tackle business predictive monitoring tasks. In this paper, we experiment and review the effectiveness of recent research on deep TPPs on the predictive business process monitoring problem. Our results suggest that TPP methods have the potential in the next activity and remaining time prediction in the predictive business process monitoring problem. The findings can be helpful to practitioners and researchers interested in developing predictive monitoring systems for business processes.