ItsDrike/itsdrike.com
1
0
Fork 0
mirror of https://github.com/ItsDrike/itsdrike.com.git synced 2025-01-23 20:14:33 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update list duplicates post

Browse source
This commit is contained in:
ItsDrike 2021-08-31 18:51:27 +02:00
parent f1833f9e09
commit 9bcc918e5e
No known key found for this signature in database
GPG key ID: B5F6B41F708C3ADD
1 changed files with 8 additions and 6 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

14
content/posts/removing-list-duplicates.md
View file

@ -6,9 +6,11 @@ tags: [programming]
In programming, we often need to handle removing duplicates from an array-like structure. While this may seem like an In programming, we often need to handle removing duplicates from an array-like structure. While this may seem like an
arbitrary and easy question, that can be solved relatively simply, that's not necessarily always the case. While it may arbitrary and easy question, that can be solved relatively simply, that's not necessarily always the case. While it may
be easy to solve, we also need to consider the runtime of the algorithm we use. be easy to solve for the obvious case of things like a list of numbers, it's not so easy if we need to deal with
non-hashable objects, while keeping the algorithm runtime relatively low.
I'll be using python for the explanations and examples, but it should be relatively similar in most languages. For this post, I'll be using python for the explanation and examples, but this will apply to every programming
language, it will just follow a different syntax.
## Removing hashable duplicates (Simple case) ## Removing hashable duplicates (Simple case)
@ -207,10 +209,10 @@ these custom classes should be defining their own `__hash__`. Again, since this
In most of the cases, the first approach will work just fine (the simple case where our list only have hashable In most of the cases, the first approach will work just fine (the simple case where our list only have hashable
objects). objects).
If however if we do need to deal with unhashables, we can either use direct memory ids and ensure that our If however if we do need to deal with unhashables, we can either use `==` comparisons, or even direct memory ids and
objects are exactly the same, or we can use some hashable counterpart to our unhashable object that could represent it. ensure that our objects are exactly the same, or we can use some hashable counterpart to our unhashable object that
We could also construct a universal hash function with serialization of our object, or a specific one if we know which could represent it. We could also construct a universal hash function with serialization of our object, or a specific
classes will be used there. one if we know which classes will be used there.
Even though we do have ways to deal with unhashables, if you're in control of the classes, and they aren't supposed to Even though we do have ways to deal with unhashables, if you're in control of the classes, and they aren't supposed to
be mutable, always make sure to add a `__hash__` method to them, so that duplicates can be easily removed in `O(n)` be mutable, always make sure to add a `__hash__` method to them, so that duplicates can be easily removed in `O(n)`