Skip to main content
revote
VIP ⭐️⭐️⭐️⭐️⭐️
July 29, 2024

How to handle post generated by AI?

  • July 29, 2024
  • 12 replies
  • 189 views

We have weird situation in our community. We have new member. Member have posted to several years old topic, gave good instructions to problem.

Post is created using chat-GPT or any other AI tools, it can be seen easily. It isnt fluent Finnish.

This is weird because post itself is ok and as said, instructions are ok. There is no any hidden agendas, there is no link to the scam pages etc.

I have problem now because I dont know what to do with the post, and the member. Is this just a test, is it possible to register and possible to post. Second post will be scam?

Generally speaking - should we automatically delete posts what are generated by AI? If there is no other reasons, let´s not to forget SEO and algorithms - we dont want to have content what is not user generated.

12 replies

jillian.bejtlich
Helper ⭐️
July 31, 2024

Of course! Here’s a helpful page on Ehawk: https://www.ehawk.net/features/risk-score.php

The tl;dr is that it’s a score that basically measures any known risks associated with a user including the domain, known malicious behavior, problem IP addresses, geographical location, etc.

Ehawk rolls all that information up into one score with a negative score indicating a problem (like a stunning -41 I came across the other day). It’s not a perfect system at all, especially since you could have a perfectly well meaning user working from a questionably location with a problem IP but it’s a tool meant to help make educated decisions.

Our trust and safety team proactively pulls this score for every single new customer that signs up and therefore I’ve got access to a database through an internally built tool. I actually just spun up an extra conversation with them looking into running all of our community users through this tool proactively so we can take action before people are a problem.

revote
revoteAuthor
VIP ⭐️⭐️⭐️⭐️⭐️
August 1, 2024

Really nice tool @jillian.bejtlich 👌 Yeah, checking the IP is problematic, not least because they usually are dynamic but as you said - tool helps to make educated decisions.

Thanks for sharing the tip!