You can certainly pursue such an approach. Might be complex and expensive, and of course you'd need appropriate labeled data for training, testing, and evaluation. The question I'd ask is how much better it will do than a simpler, cheaper approach.