How does a database handle pagination?

submitted by /u/Own-Leopard-1983 [link] [comments]

how much faster are different databases than other methods? submitted by /u/savant78 [link] [comments]

인덱스의 기본에 대해서 알아보자.Continue reading on Medium »

If databases didn’t have ACID transactions, we would all be using spreadsheets still.Continue reading on Medium »

Apa Itu DbeaverContinue reading on Medium »

submitted by /u/Adela_freedom [link] [comments]

Continue reading on Medium »

¿Alguna vez has trabajado con varias bases de datos y te ha tocado abrir MySQL Workbench, PgAdmin, SQL Server Management Studio, o MongoDB…Continue reading on Medium »

Have you ever wondered how a website ensures your username is unique, or how an e-commerce platform automatically updates your shopping…Continue reading on Medium »

ProblemContinue reading on Medium »

Save your Python app’s performance by efficiently loading queryContinue reading on Towards Data Science »

The title basically says it. I looked into Postgres but it is more disk oriented, and I also looked into VoltDB but it feels like they don't support traditional ACID transactions (they use some partitioning). So can I have some suggestions? submitted by /u/jiboxiake [link] [comments]

Introduction. In the wake of ChatGPT and other large language models (LLMs) gaining prominence, the fascination with Retrieval Augmented…Continue reading on Medium »

1. No Limit — use TopContinue reading on Medium »

What would be the best database or architecture of database + data engine for the following requirements: I will receive IOT sensor data that are almost always ordered in terms of timestamp of the signal itself. The exception being if there's network delay between different packets, so they will have to be inserted between the last 1-3 signals most likely. If no changes occur, latest row will be updated instead of doing a new insert. A signal is received from each IOT sensor every 1-5 seconds with a total of ~100,000 devices. Each IOT sensor signal is between 200 B - 2000 B, with an average size of around 500B. Each IOT sensor returns a well-defined set of fields. There are around 200 possible types of fields returned by the IOT sensor, but although it can send all 200 fields, each IOT sensor usually sends a set of 20-40 fields out of those 200 depending on user configuration. So, in terms of storage, most columns for each row will be NULL. A smaller subset of around 10 fields will always be provided by all IOT sensors Availability matters more than consistency since most data will be consumed by the client for real-time monitoring and not through the database. Historical reports queries from the database will mostly be well into the past so eventual consistency is enough. Old data (let's say 3+ months) is deleted. I need partition tolerance with distributed writes on all nodes. Conclusions until now: Partition tolerance needed Availability > consistency NULL fields should take no space Row oriented storage on disk, so that write speed is high Based on these, I am considering Cassandra/ScyllaDB with partitions based on device ID and day like 01_01_2024. However, I have some concerns with regards to query patterns: Users can retrieve a list of complete signals over a time range, like a 1-week period, for a specific device. Parallel queries across the different partitions solves this. This query would be the most used by users to get a history playback of sensor data. Basic aggregation/conditionals over a specific device like a displaying graph of a certain field with 1-hour averages as 1 data point over the span of 1 month or more. Could use parallel queries also but it's less performant since we have to go over so many more partitions and blocks in disk unnecessarily as we only need 1 field at a time for each query, so something like a column-oriented database solves this... but not Cassandra/ScyllaDB. Basic aggregation/conditionals over all or many devices over a specific field like points where a custom limit was exceeded over a time range of 1 month. Benefits from a column-oriented database as well. What is the best database(s)/architecture for this or maybe it is all solvable with Cassandra/ScyllaDB? submitted by /u/NeegzmVaqu1 [link] [comments]

I'm seeking advice on the most suitable database solution for a matchmaking feature within my application. I've tried different solutions before but have always hit a roadblock before I can finish my stuff. I need a database that has: Complex querying capabilities (e.g. check if array field contains any or all items in the array provided) Has high connection limits Cheap Note that data are short lived, if a user enters the matchmaking screen...the backend would register them in the database, once a match has been found both user shall be deleted in the table. Row level locking is also needed as to make sure that the user we're querying for is untouchable by different concurrent users. Storage size isn't actually that important since data are short lived anyways, and we're only expecting <100k rows at most. Here are the issues I have faced before: I have used DynamoDB but because of its querying limitations like not having the ability to check if an array field contains an array I have decided to steer away from it As for querying, PostgreSQL seems to be the best, first...it can lock rows which is good for a highly concurrent environment such as matchmaking and it has the querying capabilities I just need. The only problem with it is that most managed services I can find has very limited connection limits, for a matchmaking feature I'm expecting tons of users connecting, querying each other simultaneously. As for GameLift FlexMatch, it's expensive as hell...you get billed $1 per matchmaking hour, imagine a user not being able to find a match for 30 seconds, now imagine thousands of them experiencing the same thing. I think this occurrence would be common on my matchmaking feature since it would be used for a dating app in which male users are dominant than female users. submitted by /u/izner82 [link] [comments]

Hi i would like to ask in your opinions what is the best course that goes from the basics to the advanced concepts in mysql. I don't care if it is free or paid or what platform it is I just want the best so I could do good in my job so I don't get fired. submitted by /u/Minute_Courage_6664 [link] [comments]

databases that actually have a decent GUI as opposed to just doing things via the console? submitted by /u/savant78 [link] [comments]

In my React.js application I have a list of todos like this and their order can be changed Todo 1 Todo 2 Todo 3 Let's say I move the Todo 3 to top, Now the list becomes Todo 3 Todo 1 Todo 2 I want to persist the order in DB. How can I achieve this? I am using MySQL submitted by /u/Taka-tak [link] [comments]

If you're interested in distributed databases there is a free virtual event next week. r/YugabyteDB's Distributed SQL Summit (DSS) Asia (April 24th) is aimed at people interested in adopting a modern data ecosystem and simplifying their database modernization. You can find out more and register here➡️https://events.ringcentral.com/canvas/events/distributed-sql-summit-asia-2024/registration submitted by /u/Yugabeing1 [link] [comments]

Hello. I am a complete beginner and know very little about databases, but I would like to read about it and learn. I have done some internet research on books and manuals for beginners, and titles like "Designing data intensive applications", "Database internals" and "Mysql crash course" have come up. However, by reading the book description, they all seem to be business-oriented. While my interest in databases is purely to learn how to store data in a way that makes it easy to compare information (I suppose then I should learn about SPQL?), for academic research. Any recommendations or advice? submitted by /u/LoganDeya [link] [comments]

I am building an inventory management SaaS for mobile and web. I’ll be managing with a single web server. But for db, I am stuck between if I should go for Approach 1: A Database per organisation Vs Approach 2: One database shared between all organisations where each record in every table is identified by an organisation id My analysis so far is, Approach 1: - data isolated completely (peace of mind) - customer with low data will not be affected by an adjacent high data customer - moving the db around to different server can get easy - though not an intention, can convert to a custom solution at later point have no idea about scalability- is it difficult? managing backups could be difficult? Approach 2: - data isolation created with row level security of Postgres (less peace of mind though an unrealistic fear at times) - performance issues due to mixing up of high and low usage customers - easy maintenance - easy scalable ? - managing backups is easy What else am I missing ? Please do suggest me a choice about it ? submitted by /u/Prestigious_Ebb5260 [link] [comments]

I am building an app in Maui and was going to use SQLite as the database. I want to be able to also expand this app to ASP.net and possibly a Windows application at a later date. I want to use SQLite as the database and want to keep it as independent as I can from the main application. So down the road I can add in a different DB if I need to . I was reading the Maui docs and they suggest using the sqlite-net-pcl nuget package as the ORM, possibly because it is tailored for mobile apps? But the problem I see with this is I wouldn't be able to use this ORM for ASP.net or another framework that isn't mobile focused. So would I be better off using Dapper? or EF? for the sake of expansion and the ease of having it work on all frameworks? Or is there a way I can use sqlite-net-pcl with all frameworks? I have used Dapper before but never tried EF. Wasn't sure if one of these options would be a better solution. Thank you for the guidance! submitted by /u/80sPimpNinja [link] [comments]

submitted by /u/KaizenCyrus [link] [comments]

So I was assigned to make a payroll management system, and my first task was to create an ERD out of it. i would just like to know if what I'm doing is right? Or am I missing some entities or attributes? It's just a simple payroll management system. Any help would be appreciated thanks ! https://preview.redd.it/drp4kewzpruc1.png?width=1212&format=png&auto=webp&s=0e504f6bcd6ca424e48d5ed2aa7c9fe4f974f6d7 submitted by /u/9342134o_C [link] [comments]

I was looking for a way to create an ERD that can also get generated into html structure that can be navigated. I saw what Dataedo can do, which looks really amazing. But their pricing seems very high, and I don't see that I can purchase just the ER diagram tool. Are there any similar tools/vendors that can do something like what Dataedo does? What is important is that I can edit the description of tables/columns/objects (etc) in the XML files and then maybe use a tool to generate the HTML that can be served locally or thrown into a web app in Azure or something. submitted by /u/Genuine-User [link] [comments]

submitted by /u/DeadDolphinResearch [link] [comments]

I am building a world database of schools for an awareness project at work. All the information is public, but I have to find it separately in each of the schools websites, which given its an international database, will take me ages. ​ Is there a shortcut? ​ Thanks! submitted by /u/Exotic_Ad4675 [link] [comments]

Hello, Not sure if I am in the correct sub. However, I am looking for a person to set up a database and an app for a website. We're trying to cut cost within reason and preferably looking for people based in Australia, New Zealand. We're trying to avoid currency costs exchange so preferably outside of USA and Western Europe but I will consider all responses. If you need more information just let me know or dm me a message. submitted by /u/captaingirl2 [link] [comments]

Hello! I am building a database system and want to add Deadlock prevention (Wait-die), but have some questions regarding consistency and aborts. Let's say I have T1 and T2, S(X) - read lock, U(X) - update lock, W(X) - write lock: T1: R(X) W(X) T2: R(X) W(X) Both transactions will receive an S(X) lock and then will try to upgrade to W(X). This, of course, leads to deadlock (sad for deadlock prevention mechanism) My question: How do I deal with this? Transactions release R(X) and try to get W(X) - Consistency violation I thought about adding a U(X) lock that is exclusive to U(X) and W(X) but is not limiting S(X). So T1 will receive U(X) and will be able to upgrade to W(X). The problem is what to do with T2? I cannot let it wait for T1 to finish, because then the consistency is violated. Should I then abort and restart T2 instead? Another issue is, how to understand which type of lock to receive - provided I can't infer from the API the access pattern (kind of like how updates use U(X) lock in SQL databases) I haven't been able to find an answer online on this matter, but if anyone knows some - would also be appreciated! submitted by /u/Volume999 [link] [comments]

database that is a MariaDB database? submitted by /u/savant78 [link] [comments]

I made this video (https://www.youtube.com/watch?v=_JGgGR3Rp60) a while back about different caching strategies. In it, I explain: Side Cache Read-Through Cache Write-Through Cache Write-Behind Cache Write-Around Cache. Having a good handle on these has been very important for us at Superthread as one of our key differentiators is speed at scale. btw. Superthread is an all-in-one project management software and wiki for small teams. I hope that some of you find it useful & interesting. submitted by /u/totally_random_man [link] [comments]

Heyo, I stumbled upon this youtuber that seems to be a lecturer at an university putting all of his material online. It's compact and divided into seperate 3-20 min videos, and handles a ton of database stuff. If you're stuck w/ something or need some extra info, you might find it on there. Just here to drop this off for a future google-searcher 😉 The channel is called Theoretical Computer Science, @ TheComputerScience, has about 2k subs. submitted by /u/EkkosFatNuts [link] [comments]

when using a database, such as MariaDB on a server, is the database queried directly by the html that teh client uses, or, does the client query data in the database by sending a POST or GET to for ex an intermediate fle, such as a python file, and then that python file queries the database and then returns the data to the client? submitted by /u/savant78 [link] [comments]

I'm looking for a laptop to install Linux Oracle on it. I also have a Macbook but it does have some serious compatibility issues with Oracle and I'm pursuing the database so install some other database-related software too. So please suggest to me some laptops that are decent to run Oracle or tell me the specs I tried to find offline market submitted by /u/rohit_1824 [link] [comments]